-- Logs begin at Thu 2022-08-25 01:52:29 UTC, end at Thu 2022-08-25 03:13:48 UTC. -- Aug 25 02:42:00.160171 dv-cinder-851640-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 02:42:00 2022] *** Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: nodename: dv-cinder-851640-5-smb Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: machine: x86_64 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: clock source: unix Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: pcre jit disabled Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: detected number of CPU cores: 4 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: current working directory: / Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: detected binary path: /usr/bin/uwsgi-core Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: your processes number limit is 47680 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: your memory page size is 4096 bytes Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: detected max file descriptor number: 2048 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: lock engine: pthread robust mutexes Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: thunder lock: enabled Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 25 02:42:00.173971 dv-cinder-851640-5-smb devstack@keystone.service[81608]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 02:42:00.215162 dv-cinder-851640-5-smb devstack@keystone.service[81608]: Python main interpreter initialized at 0x55fd0ef769c0 Aug 25 02:42:00.215162 dv-cinder-851640-5-smb devstack@keystone.service[81608]: python threads support enabled Aug 25 02:42:00.215162 dv-cinder-851640-5-smb devstack@keystone.service[81608]: your server socket listen backlog is limited to 100 connections Aug 25 02:42:00.215162 dv-cinder-851640-5-smb devstack@keystone.service[81608]: your mercy for graceful operations on workers is 90 seconds Aug 25 02:42:00.215546 dv-cinder-851640-5-smb devstack@keystone.service[81608]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 02:42:00.215646 dv-cinder-851640-5-smb devstack@keystone.service[81608]: *** Operational MODE: preforking *** Aug 25 02:42:00.215953 dv-cinder-851640-5-smb devstack@keystone.service[81608]: *** uWSGI is running in multiple interpreter mode *** Aug 25 02:42:00.215953 dv-cinder-851640-5-smb devstack@keystone.service[81608]: spawned uWSGI master process (pid: 81608) Aug 25 02:42:00.216164 dv-cinder-851640-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 25 02:42:00.220107 dv-cinder-851640-5-smb devstack@keystone.service[81608]: spawned uWSGI worker 1 (pid: 81623, cores: 1) Aug 25 02:42:00.220107 dv-cinder-851640-5-smb devstack@keystone.service[81608]: spawned uWSGI worker 2 (pid: 81624, cores: 1) Aug 25 02:42:00.220107 dv-cinder-851640-5-smb devstack@keystone.service[81608]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 02:42:04.537291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:42:04.537291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Aug 25 02:42:04.538097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:42:04.538097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: from cryptography.utils import int_from_bytes Aug 25 02:42:04.538510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:42:04.538510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: from cryptography.utils import int_from_bytes Aug 25 02:42:04.538617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:42:04.538617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: from cryptography.utils import int_from_bytes Aug 25 02:42:04.588642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:42:04.588839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:42:04.588930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:42:04.589017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:42:04.589097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] command line args: [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:42:04.589168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] command line args: [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:42:04.589314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:42:04.589401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:42:04.589478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ================================================================================ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:42:04.589584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ================================================================================ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:42:04.589744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] admin_token = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.589833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.589998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_dir = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_dir = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] config_source = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] config_source = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] debug = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] debug = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.590817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.591949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_config_append = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_config_append = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_dir = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_dir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.592957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.593994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.594886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.595833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.596902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] publish_errors = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] publish_errors = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.597994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] standard_threads = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] standard_threads = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.598959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_journal = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_journal = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_json = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_json = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_stderr = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_stderr = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] use_syslog = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] use_syslog = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.599977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:42:04.600158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.600937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.601922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.602961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.603992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.604845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.605987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.606895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.607907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.608868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.609918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.610915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.611933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.612986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.613895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.614929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.616992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.617898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.618980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.619859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.620517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.620599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.620673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.620786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.620872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.621915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.622956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.623962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.624979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.625999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.external = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.external = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.626901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.password = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.password = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] auth.token = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] auth.token = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.627859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.628852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.629992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630721 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.630966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.631968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.632849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.633831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.634960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.635046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.635199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.635282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.635450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.635527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.636878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.637855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.638982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.639930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.640957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.641940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.642969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.643922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.644937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.645953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.646922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.647994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.648986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.649970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.650957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.651941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.652946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.653923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.654076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.654159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.654321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.654518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.654944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.655359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.655359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.655978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.656667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.657965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.658990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.659946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.660902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.661904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.662909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.663907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.664892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.665948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.666983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.667946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.668968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.669930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.670918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.671901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.672885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.673900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.674908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.675853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.676856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.677970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678543 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81623) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:42:04.678690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:42:04.678843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:42:04.709248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.709477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.709591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.709704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.709836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.710068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.718285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.718721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.747307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.747531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.747779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.748018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.801424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.801751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.851072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.851306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.851749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:04.851987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.009277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.009523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.009741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.009969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.010187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.010392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.010479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.010662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.010889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.011110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.011330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.011547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.034940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.035916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.047717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.047836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.061892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81623) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.062926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81624) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:42:05.079293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.079504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:42:05.079674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.079856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.079984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:42:05.080129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:42:05.080257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.080493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.080622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:42:05.080748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.080883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.081061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.081149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.081384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.081592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.081864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.090747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.091813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.092094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.098531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.099072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.101447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.101739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.101986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.102132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.102938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.103940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.104101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.104280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.104940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.105117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.105394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.128097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.128640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.129619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.129916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.130134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.130433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.134588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.134877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.135089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.135218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.135363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.135721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.141573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.141865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.142070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.142367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.146066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.146245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.146452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.146582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.146733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.146870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.147935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.148196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.148532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.165953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.166246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.166388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.166541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.170677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.170998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.173912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.174215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.174345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.174519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.178406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.178718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.181539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.181867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.185374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.185782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.185926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.185926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.186830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.187250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.187453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.202404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.202709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.202839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.202998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.203123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.203285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.203411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.203624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.210149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.210445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.211675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.211967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.212094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.212258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.215156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.215433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.215621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.215750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.215887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.216015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.216139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.216272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.216426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.216580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.227512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.227802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.227943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.228095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.228984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.229109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.229287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.230053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.230214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.245385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.245779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.248383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.248813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.251291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.251682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.252756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.253162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.254252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.254539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.254758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.254953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.255141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.255278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.261372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.261688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.262779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.263141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.265714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.266932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.274500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.274813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.274943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.275100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.275244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.275396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.282505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81624) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.282796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81623) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:42:05.282938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.283909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.284881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.285962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.286085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.286208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81624) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.286330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81623) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:42:05.320473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd0ef769c0 pid: 81624 (default app) Aug 25 02:42:05.320732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55fd0ef769c0 pid: 81623 (default app) Aug 25 02:42:05.324037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac24c5-e17c-46fa-a7f8-563e23e7a462 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:05.324330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac24c5-e17c-46fa-a7f8-563e23e7a462 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:05.325498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac24c5-e17c-46fa-a7f8-563e23e7a462 None None] PATH_INFO: `/v3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:05.328882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu Aug 25 02:42:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:11.927317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:11.927829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:11.927912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:11.932376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:11.937796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:11.938203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:11.938408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:12.009358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: INFO dbcounter [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] Registered counter for database keystone Aug 25 02:42:12.029061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG oslo_db.sqlalchemy.engines [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:42:12.035789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writer thread running {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:42:12.213908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG passlib.handlers.bcrypt [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81624) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:42:12.214248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG passlib.handlers.bcrypt [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81624) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:42:12.269172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:12.270784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:12.404497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:42:12.919018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:12.987325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: INFO dbcounter [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] Registered counter for database keystone Aug 25 02:42:13.008761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG oslo_db.sqlalchemy.engines [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81623) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:42:13.016731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writer thread running {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:42:13.141262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece3ab38-6440-4ac7-bca5-e031c780f789 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:13.145572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:13.146207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:13.146489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:13.146764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:13.155398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:13.206580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:42:13.206865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ec59cc-91d6-4bab-bce4-2324f70fd7f4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:13.217259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Aug 25 02:42:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:42:13.223257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:13.237567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3655e2-8991-41dd-8ac1-03a18a2b13cf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:13.242225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:13.243319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:13.243605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:13.243878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] PATH_INFO: `/v3/projects/5c90428e27344b52a75997c9ee93262e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:13.245458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] RBAC: Authorizing `identity:get_project(project_id=5c90428e27344b52a75997c9ee93262e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:13.298512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING keystone.common.rbac_enforcer.enforcer [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:42:13.298856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799cee0d-1157-4129-955b-8c1b716d98ee admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:13.303418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu Aug 25 02:42:13 2022] GET /identity/v3/projects/5c90428e27344b52a75997c9ee93262e => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:15.186508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c794a-d8ea-4780-a760-471d78361ab9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:15.187081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c794a-d8ea-4780-a760-471d78361ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:15.187081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c794a-d8ea-4780-a760-471d78361ab9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:15.191202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:15.196620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:15.197123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:15.197220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:15.217218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:15.218718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:15.226491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:42:15.499016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c794a-d8ea-4780-a760-471d78361ab9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:15.511170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c794a-d8ea-4780-a760-471d78361ab9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:15.515380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:15.515974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:15.516255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:15.516559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:15.524175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:15.526008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e14a9b-d7a3-4260-990b-45dd9c651a37 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:15.534718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu Aug 25 02:42:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:42:15.540157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:15.549732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d28785b-4216-45de-8567-5bbee7d4716a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:15.554081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:15.554704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:15.554984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:15.555257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:15.556594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:15.559051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883a286-212a-4a68-9509-542e2e6e96d6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:15.560637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu Aug 25 02:42:15 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:17.521090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9898-5911-47e0-a808-b3c66dd839e1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:17.521615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9898-5911-47e0-a808-b3c66dd839e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:17.521615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd9898-5911-47e0-a808-b3c66dd839e1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:17.522958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:17.528125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:17.528584 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:17.528682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:17.546041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:17.547202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:17.583838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f241dc-2899-4edd-a661-5168b665c1d2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:17.584122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f241dc-2899-4edd-a661-5168b665c1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:17.584416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f241dc-2899-4edd-a661-5168b665c1d2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:17.585766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:17.590736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:17.591023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:17.591302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:17.628599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:17.634124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81623) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:42:17.634502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG passlib.handlers.bcrypt [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81623) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:42:17.679645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:17.681254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:17.778289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:17.900005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:17.924292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.005339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7157245-7d25-49f7-98c7-23ac8cc666c2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.037896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.038540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.038825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.039109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.040084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.051716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:18.060513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:18.061436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:18.062285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 7/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:18.067411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.142905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5159a41f-7903-4661-b38f-df71633cc714 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.145196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.149681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.169553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636536d-0642-4ae4-adf5-6916797e59d3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.182734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.183603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.183888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.184167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.202981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.203592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.203873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.204146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.204884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:18.205191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.206585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.218641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 8/15] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:18.224357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.251214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.252773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.324111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6d26b4-c9ff-4b0d-865e-440c0e85398e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.349369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:42:18.354956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.357848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.359287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.359941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.360252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.360621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.361829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.363844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.364949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 9/17] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:18.370688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.387989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.457518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b82558-5385-491a-ac68-7d8b4f225b5b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.476017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638cc4c-d4c6-4cce-9bab-1cbe9176ad2b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.491272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.492405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.492699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.493015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.509538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.510172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.510959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.511234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.512111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.512357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.513630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.513835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.515511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:18.521222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:42:18.532574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:18.533765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:42:18.534665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:42:18.534665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:42:18.534665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:18.534665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:42:18.539376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:18.595588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.604411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:18.624444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7406ca54-7eba-402b-99bc-bf8454acaa9b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.639762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0232ac-532c-42de-8f55-39bc46531bae None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:18.659755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.660373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.660679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.660953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.661679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.domain.id=default, user.id=0022827a1ab44829a57581031fab2445) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:18.661984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.663427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99a34b5-ba69-447f-adf1-e2179522f8e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.670227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/role_assignments?user.id=0022827a1ab44829a57581031fab2445&scope.domain.id=default&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:18.672673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:18.673289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:18.673565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:18.673844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:18.674496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:18.674801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:18.676218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdcab23-a4c3-40ea-ae3a-db9f1bb7bab4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:18.696962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:20.839058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3abd-a3a1-4457-8fe4-876f69a866be None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:20.840090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3abd-a3a1-4457-8fe4-876f69a866be None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:20.840638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae3abd-a3a1-4457-8fe4-876f69a866be None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:20.842189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:20.847400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a9db-3e5e-46cf-9d04-74d7a9aa6d9e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:20.847807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a9db-3e5e-46cf-9d04-74d7a9aa6d9e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:20.847971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0727a9db-3e5e-46cf-9d04-74d7a9aa6d9e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:20.849618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 11/23] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:20.850992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100990-a432-48ad-a97d-9d249e63071b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:20.851499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100990-a432-48ad-a97d-9d249e63071b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:20.851982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a100990-a432-48ad-a97d-9d249e63071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:20.854671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d5d-7a3c-43da-97f9-c6f2b45e0295 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:20.854946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d5d-7a3c-43da-97f9-c6f2b45e0295 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:20.855510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c1d5d-7a3c-43da-97f9-c6f2b45e0295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:20.874015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0a100990-a432-48ad-a97d-9d249e63071b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:20.875240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0a100990-a432-48ad-a97d-9d249e63071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:20.885823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-472c1d5d-7a3c-43da-97f9-c6f2b45e0295 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:20.887145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-472c1d5d-7a3c-43da-97f9-c6f2b45e0295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:20.992665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 13/24] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 25 02:42:21.022658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 12/25] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:21.133388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef7a-5b55-4663-9aaf-7c35c3c1fa30 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.133673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef7a-5b55-4663-9aaf-7c35c3c1fa30 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.133868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858ef7a-5b55-4663-9aaf-7c35c3c1fa30 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.135226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 14/26] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:21.141514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.141807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.142090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.163218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:21.164423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:21.220132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:21.251947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 13/27] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:21.373880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ef7a-5b55-4663-9aaf-7c35c3c1fa30 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:21.475207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:21.510848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858ef7a-5b55-4663-9aaf-7c35c3c1fa30 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:21.551853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:21.552515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.552798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.553081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.563686 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:21.568684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:21.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:21.570272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 15/28] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:21.576528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:21.586396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:21.759340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39626a1-f1ec-4a3c-ba7b-24b5e78b5e4e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:21.777078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5febf6a-353e-46f8-aa4d-5c2bb71f814f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:21.824931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:21.825559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.825842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.827291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.827974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:21.828281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:21.830481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:21.844962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:21.845595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.846046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.846317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.848407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 14/29] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:21.849244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:21.853152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:21.863265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:21.865244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9f2f661a-d8ef-4227-927a-98f47cc674d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:42:21.883131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:21.884007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:42:21.884840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:42:21.884840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:42:21.884840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:21.887289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 16/30] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:21.888859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39696d2-6feb-4662-b62c-4d3399b17b8c None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:21.889550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39696d2-6feb-4662-b62c-4d3399b17b8c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:21.890038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39696d2-6feb-4662-b62c-4d3399b17b8c None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:21.891597 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 17/31] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:21.892565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39696d2-6feb-4662-b62c-4d3399b17b8c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:21.899982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:21.966903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ca6b0-d1c0-4e57-a563-b6b8327341af None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.006635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.007594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.008098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.008630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.009552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.011759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c6610d-b56a-4589-899a-5fc0b3124762 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.014717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39696d2-6feb-4662-b62c-4d3399b17b8c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.053408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.054055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.054341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.054622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.055752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.057903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.064000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 18/32] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:21 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:22.064000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:22.120823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:22.156737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 15/33] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Aug 25 02:42:21 2022] POST /identity/v3/roles => generated 219 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:22.158747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.159385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.159872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.171519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53808180-038b-4e7b-a0f4-354ee4adf151 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.182970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:22.185082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:22.211947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.212614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.212897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.213239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.214205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:22.214395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.215818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.237830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 19/34] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:22.238511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:22.266676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 16/35] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:22.268047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:22.320329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:22.362380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f03ce-f48a-4323-9bca-9d8a26cd2d18 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.379783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:22.424447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372856ff-168e-4a45-a9f2-ac02c55bba4a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.427320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.428241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.428762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.429355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.430699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.433087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a77a52-87aa-48a4-ab3a-cf15d2f60225 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.435117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 20/36] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:22.439783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500f8b-4fd3-4b27-bcaf-057c000bb4f0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.440349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500f8b-4fd3-4b27-bcaf-057c000bb4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.440945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d500f8b-4fd3-4b27-bcaf-057c000bb4f0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.442761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 21/37] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:22.443479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500f8b-4fd3-4b27-bcaf-057c000bb4f0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:22.482762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.483385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.483672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.483950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.484955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.487606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a1a63f-c32f-4f88-8047-9f53fa306ff9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.521389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 17/38] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:42:22 2022] POST /identity/v3/projects => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:22.522933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.523229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.523509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.557843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:22.559373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:22.566357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d500f8b-4fd3-4b27-bcaf-057c000bb4f0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.605912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.607949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.608267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.608732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] PATH_INFO: `/v3/domains/default/users/0022827a1ab44829a57581031fab2445/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.611135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0022827a1ab44829a57581031fab2445, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.612710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21094767-bb2a-44b4-9d2c-fa4795e494e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.681023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 18/39] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:22.681951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:22.695215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:22.763349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 22/40] 10.222.0.64 () {58 vars in 1361 bytes} [Thu Aug 25 02:42:22 2022] PUT /identity/v3/domains/default/users/0022827a1ab44829a57581031fab2445/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:22.811379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67002b-a845-48ac-8a0e-a03c7bcde866 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:22.852320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:22.853001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.853241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.853525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.854256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:22.855708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98090a57-a41d-4882-98eb-ff3ede095a56 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:22.873825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 19/41] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Aug 25 02:42:22 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:22.921686 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534423-4b53-4902-a6d4-7ff7a5de2c70 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.922180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534423-4b53-4902-a6d4-7ff7a5de2c70 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.922253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc534423-4b53-4902-a6d4-7ff7a5de2c70 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.927208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 23/42] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:22.933559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:22.933870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:22.934134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:22.954718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:22.955993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:23.033515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:23.034029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534423-4b53-4902-a6d4-7ff7a5de2c70 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:23.041816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 20/43] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:23.092270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:23.165788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc534423-4b53-4902-a6d4-7ff7a5de2c70 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:23.202544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:23.203177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:23.203467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:23.203745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:23.204436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:23.206138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:23.223255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 24/44] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Aug 25 02:42:23 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:23.319754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:23.431603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2292a3b-e15c-4551-9f24-3c2b34aa1f67 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:23.467642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:23.468279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:23.468601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:23.468881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:23.469995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:23.471447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567863c-f9a6-46dd-8292-a48b0350d5a1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:23.473057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 21/45] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:23.479420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:23.579337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c25f0f-f6a9-48bf-b74f-ccec5851f384 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:23.580879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:23.614178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:23.614794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:23.615079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:23.615361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:23.615997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:23.617755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c32ea2b-8aea-481b-bd34-cf50607e0008 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:23.752884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 25/46] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:42:23 2022] POST /identity/v3/projects => generated 312 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:24.785275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d8e9-6408-4e09-8694-33aa8c901325 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:24.785789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d8e9-6408-4e09-8694-33aa8c901325 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:24.785871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f9d8e9-6408-4e09-8694-33aa8c901325 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:24.787190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 22/47] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:24.792567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:24.792962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:24.793130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:24.811480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:24.813009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:24.880309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 26/48] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:25.150032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d8e9-6408-4e09-8694-33aa8c901325 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:25.216659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:25.252161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f9d8e9-6408-4e09-8694-33aa8c901325 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:25.284980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:25.285612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.285889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.286162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.297541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:25.303611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:25.304591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:25.310434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 23/49] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:25.311102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:25.393053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:25.411754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16301e7d-357b-43a6-9773-16453da7c4e1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:25.445534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:25.446488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.446488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.446705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.447375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:25.447717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:25.449153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:25.457369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 27/50] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:25.462897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:25.561489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4eba8-d688-44a2-aa11-8cd87cd4c589 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:25.586050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:25.594567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:25.595195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.595476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.595753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.597134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:25.598592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09835d-f5db-4515-8edc-3b891922f74c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:25.600168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 24/51] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:25 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:25.606535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:25.671349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946df0c-7ca6-4446-afc7-e0185934a9a0 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.671640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946df0c-7ca6-4446-afc7-e0185934a9a0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.671925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946df0c-7ca6-4446-afc7-e0185934a9a0 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.673300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 25/52] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:25.678167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.678450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.678726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.696060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:25.697297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:25.704952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a31a1f-1284-4246-88ff-9287cc7801e3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:25.738902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:25.739535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.739815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.740091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.741227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:25.742942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:25.749274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 28/53] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:25.750220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:25.764407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 26/54] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:25.765756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:25.849710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db819d-03f0-4226-97b9-62bc53a9b187 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:25.881943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:25.882547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:25.882828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:25.883101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:25.883815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.domain.id=default, user.id=0022827a1ab44829a57581031fab2445) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:25.884118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:25.886094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:25.891622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 29/55] 10.222.0.64 () {56 vars in 1322 bytes} [Thu Aug 25 02:42:25 2022] GET /identity/v3/role_assignments?user.id=0022827a1ab44829a57581031fab2445&scope.domain.id=default&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:26.037092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:26.136689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62633b6e-4e47-4a02-b2f0-f78d08bdc1de None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:26.266054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:26.275121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:26.275783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:26.276069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:26.276343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:26.277476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:26.278926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c840740-df95-4f4e-854f-728ffca26594 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:26.280526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 27/56] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:26.286128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:26.361341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:26.383044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa69ffa-7b20-4cb5-b7a5-bc3f0b825cf5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:26.416253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:26.416890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:26.417177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:26.417456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:26.418095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:26.419564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6bd596-0ef3-41c7-90ce-4821dcd1bc88 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:26.446317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 30/57] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Aug 25 02:42:26 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:28.353387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7a3-485d-463a-89d9-9810524e813a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:28.353901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7a3-485d-463a-89d9-9810524e813a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:28.354010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03f7a3-485d-463a-89d9-9810524e813a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:28.355322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 28/58] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:28.360579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:28.360983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:28.361143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:28.380119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:28.381396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:28.447236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 31/59] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:28.724356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f7a3-485d-463a-89d9-9810524e813a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:28.822294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03f7a3-485d-463a-89d9-9810524e813a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:28.854984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:28.855597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:28.855876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:28.856149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:28.857268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:28.858702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cf089-a699-4b80-a389-72e8ae820721 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:28.860242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 29/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:28.865796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:28.922995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:28.962912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184fb912-e6a8-4cf3-84ec-603b55c2cba3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:28.996747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:28.997292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:28.997573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:28.997848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:28.998494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:28.999947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9748b3b-23ec-4280-94bd-c00c330ceed6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:29.030309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 32/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:28 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:42:31.993942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8412-65f4-4d3e-a9c5-ae08a414fa73 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:31.995021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8412-65f4-4d3e-a9c5-ae08a414fa73 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:31.995511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0b8412-65f4-4d3e-a9c5-ae08a414fa73 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:31.997126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 30/62] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:32.002637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ff0c-7e46-40c9-9b5c-356ac4ea6e17 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.003461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ff0c-7e46-40c9-9b5c-356ac4ea6e17 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.003958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613ff0c-7e46-40c9-9b5c-356ac4ea6e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.030469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a613ff0c-7e46-40c9-9b5c-356ac4ea6e17 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:32.032043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a613ff0c-7e46-40c9-9b5c-356ac4ea6e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:32.105204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 33/63] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:32.116149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967227-3027-442c-8262-6244e3193469 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.116782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967227-3027-442c-8262-6244e3193469 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.117519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45967227-3027-442c-8262-6244e3193469 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.119067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 31/64] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:32.125692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209f6d-c506-419a-af31-f5ded7b99a87 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.126346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209f6d-c506-419a-af31-f5ded7b99a87 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.126843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6209f6d-c506-419a-af31-f5ded7b99a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.156290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b6209f6d-c506-419a-af31-f5ded7b99a87 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:32.157902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b6209f6d-c506-419a-af31-f5ded7b99a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:32.217505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:32.251514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 34/65] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:32.351084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907bf67-12d6-4fc7-a43c-979655f72461 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.351398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907bf67-12d6-4fc7-a43c-979655f72461 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.351660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907bf67-12d6-4fc7-a43c-979655f72461 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.353313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 32/66] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:32.358414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd31d-623d-42f5-8dbf-6acd459993fe None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.358713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd31d-623d-42f5-8dbf-6acd459993fe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.358996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fbd31d-623d-42f5-8dbf-6acd459993fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.386114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-55fbd31d-623d-42f5-8dbf-6acd459993fe None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:32.387346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-55fbd31d-623d-42f5-8dbf-6acd459993fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:32.474883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 35/67] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:32.482839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044b2b-b8b0-4a0a-b0d6-de215b37d366 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.483399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044b2b-b8b0-4a0a-b0d6-de215b37d366 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.483877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c044b2b-b8b0-4a0a-b0d6-de215b37d366 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.485564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 33/68] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:32.490846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.491141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.491421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.502569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c044b2b-b8b0-4a0a-b0d6-de215b37d366 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:32.517482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:32.519025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:32.613857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:32.646865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 36/69] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:32.667500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c044b2b-b8b0-4a0a-b0d6-de215b37d366 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:32.709571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:32.711606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:32.712260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.712576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.712858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.735331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:32.740307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:32.741168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:32.742165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 34/70] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:32.749184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:32.752492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:32.821959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752dc51-fa81-4aac-853c-b0535a001dce None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:32.854333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f8408-6d31-4e81-a664-01060af6c711 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:32.858310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:32.859208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.859717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.860195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.871809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:32.877029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:32.877884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:32.879007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 37/71] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:42:32.879934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:32.880803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:32.895681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:32.896589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.897033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.897449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.898263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:32.898708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:32.900235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bb3f34-9ad4-4893-9834-abc86fdbb0cb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:32.908878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 35/72] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:32.910273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035190-b514-4e96-acb8-6bf673838450 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:32.910694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035190-b514-4e96-acb8-6bf673838450 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:32.911112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9035190-b514-4e96-acb8-6bf673838450 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:32.912623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 36/73] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:32.913735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035190-b514-4e96-acb8-6bf673838450 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:32.987206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:32.993858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95393b6e-d5a1-4742-b8e8-20d19d3556b0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.022618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9035190-b514-4e96-acb8-6bf673838450 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.027485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.028116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.028409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.028699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.038895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:33.044251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:33.045148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:33.045900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 38/74] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:33.046508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.059838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.060484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.060782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.061041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.061706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:33.062008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.063401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ff41f-6bfa-4d94-b9fa-c96bc42f9715 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.071306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.072594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.072830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.073108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.090451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:33.091669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:33.132837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.146010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c5a93-7a10-40b3-b400-661f5577c015 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.157226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 38/76] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:33.159212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.180797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.181431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.181727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.181997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.196995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.198480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.200737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 39/77] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.201832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.217616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.269945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e88b065-0d62-473f-9d08-8f936531e28c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.306404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea625a-4912-4a45-ac93-5d34cbdffda9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.310365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.311013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.311299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.311576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.324291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:33.329315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:33.330326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:33.331236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:33.333134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:33.334046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.348381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.348381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.348381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.348381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.348721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:33.348908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.350308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.358841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.363164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.377870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.448296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.450777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd03d7-708e-406c-ba23-83ace93fb76b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.472217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b719e-5cbf-41eb-812d-1d848fdbd128 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.483804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.484455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.484735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.485007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.486212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.487643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.489243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 40/80] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.493648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.506722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.507337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.507623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.507902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.579094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.580547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.592285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc27e62f-ee3c-4218-9897-307c21080823 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.595316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.628099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.628735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.629024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.629304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.629979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:33.630282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.631662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.639700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 41/81] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.641354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.654808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.679156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 41/82] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:33.681281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.745259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7995586a-c81e-4ca6-9780-32458d1341f2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.778532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.779163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.779451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.779732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.780908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.780998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a034a-8436-4371-b060-b3c25fbe5d84 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.782375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.783981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 42/83] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.784785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.815321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.815955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.816240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.816550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.817661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.818594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.819123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.820772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 42/84] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.821702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.867759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:33.889208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f05dfa-3ed1-43a3-b367-9167e929a55d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.922291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd79a41-ef5d-41c9-9f83-65a3c4875c70 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:33.923712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.925013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.925013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.925013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.955394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:33.955786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:33.956070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:33.956350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:33.957522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.958994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:33.960597 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 43/85] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:33.961365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:33.992771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:33.994243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.028402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.061151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90862fa8-232b-4580-be3c-9a639a82c430 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.074737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.096118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 43/86] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:34.096800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.097501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.097788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.098067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.099229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.100863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.101374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.107067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 44/87] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:33 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:34.107067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.198997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146be47e-05fb-40c6-b11c-e9a9123b4c76 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.202003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933c87a-224b-4acc-9a9d-5307695bc0dc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.232419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.233025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.233310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.233592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.235824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.236451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.236566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.236735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.237008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.237646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.239086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.264687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 45/88] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:34 2022] POST /identity/v3/users => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:34.264687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.303695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.317398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.318889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.392161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46161d0c-c4ee-4043-9c86-823ad08e6c45 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.433248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 44/89] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:34.433929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.434201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.434684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.434977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.435287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.475567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.523023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.524934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.562735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57ff82-184a-4bd8-b039-bb7b7db4774b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.569370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.610165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.610806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.611090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.611633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.613415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.615507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.618471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:34.619891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.656347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 46/91] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:34.657665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.754524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb09972-633e-4bb9-85ee-46fe8efffef6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.756127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.792152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.792784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.793069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.793347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.794176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:34.794492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.796088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.798414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e963f4e-22ab-4791-98eb-051d09518527 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:34.804985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 46/92] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:34.805708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.843576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:34.844518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:34.844945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:34.845387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:34.847476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:34.849152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:34.851188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 47/93] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:34.852926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:34.858677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:34.975870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d996732a-de11-4bcd-abb7-87d605b20f3c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:35.018224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:35.019634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:35.020142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:35.020673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] PATH_INFO: `/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:35.022303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] RBAC: Authorizing `identity:get_project(project_id=ec2a7e5272e94f8d8680b7a8f1c26564)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:35.024048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:35.026493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 48/94] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:35.027662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:35.053866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97e309-d2e1-451a-aa4b-a9f90a095c3c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:35.110602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:35.131720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:35.132346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:35.132652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:35.132929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:35.133674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=0022827a1ab44829a57581031fab2445) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:35.133966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:35.135778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:35.145919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d8538-b586-4b42-a943-54000a788bdb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:35.147925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 47/95] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:34 2022] GET /identity/v3/role_assignments?user.id=0022827a1ab44829a57581031fab2445&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:35.149505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:35.189948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:35.190957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:35.191437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:35.191907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:35.193670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:35.194221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:35.196001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1f73ef-a6f5-4c51-b616-5adff008f57e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:35.203611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:35 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:35.225976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:35.340943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6bcfbe-4297-4a7b-9ac1-273b995ad92d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:35.390155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:35.390791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:35.391081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:35.391360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:35.392107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=ec2a7e5272e94f8d8680b7a8f1c26564, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:35.392453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:35.393934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b245c-4371-48e7-a7db-2f87edbb0051 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:35.409041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 48/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:35 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=ec2a7e5272e94f8d8680b7a8f1c26564&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:36.784232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5df3-4717-45d1-97f7-25e7380f093a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:36.785274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5df3-4717-45d1-97f7-25e7380f093a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:36.785780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5df3-4717-45d1-97f7-25e7380f093a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:36.787625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 50/98] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:36.797855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849309e1-be35-4aac-ad99-c4fa371cc0b1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:36.798756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849309e1-be35-4aac-ad99-c4fa371cc0b1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:36.799273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849309e1-be35-4aac-ad99-c4fa371cc0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:36.826071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-849309e1-be35-4aac-ad99-c4fa371cc0b1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:36.827634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-849309e1-be35-4aac-ad99-c4fa371cc0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:36.910145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 49/99] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:36.959378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff19c62-aeb9-43d3-a38a-ce2a88e2bd53 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:36.959985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff19c62-aeb9-43d3-a38a-ce2a88e2bd53 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:36.960538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff19c62-aeb9-43d3-a38a-ce2a88e2bd53 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:36.962368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 51/100] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:36.967430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:36.967950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:36.968451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:36.991299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:36.993073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:37.019212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:37.088376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 50/101] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:37.269925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff19c62-aeb9-43d3-a38a-ce2a88e2bd53 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:37.404536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff19c62-aeb9-43d3-a38a-ce2a88e2bd53 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:37.452080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:37.452771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.453054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.453333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.456592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:37.465978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:37.470537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:37.475494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:37.476350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:37.477526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 52/102] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:37.482928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:37.599931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76d47e3-444c-4add-aeec-23680a88f35f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:37.635872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:37.636477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.636767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.637046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.638169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:37.639638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:37.641296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 51/103] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:37.647482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:37.677126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6683a22-c8f1-4735-aaa1-29811fe7a1a7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:37.684226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:37.775174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3dde-3cdf-421f-84c7-bee9572b369d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:37.782517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:37.783443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.783986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.784503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.785803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:37.786306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:37.787896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:37.807665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 53/104] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:37.813356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:37.813916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:37.814551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.814829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.815107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.817496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:37.817496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8b02de-25a8-4fb2-b4c1-67fb46ba6a4e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:37.849759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 52/105] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:42:37 2022] POST /identity/v3/projects => generated 302 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:42:37.851282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74402f8-2464-4d5b-9244-7bc4589f8f29 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.851627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74402f8-2464-4d5b-9244-7bc4589f8f29 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.851965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74402f8-2464-4d5b-9244-7bc4589f8f29 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.858168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 53/106] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:37.863654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea2d6-4c79-4a8f-abe0-9042785e592b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:37.863950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea2d6-4c79-4a8f-abe0-9042785e592b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:37.864231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eea2d6-4c79-4a8f-abe0-9042785e592b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:37.897424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e9eea2d6-4c79-4a8f-abe0-9042785e592b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:37.898609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e9eea2d6-4c79-4a8f-abe0-9042785e592b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:37.950409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.039717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 54/107] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:38.041962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658bbaa-b988-4193-bbd4-678639e7feff None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.042254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658bbaa-b988-4193-bbd4-678639e7feff None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.042531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1658bbaa-b988-4193-bbd4-678639e7feff None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.043012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a111a6-6fd3-4194-be72-6a6557c56a1c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:38.043850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 55/108] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:38.049476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d8f3-5132-474a-81e1-e666c110d6df None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.049768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d8f3-5132-474a-81e1-e666c110d6df None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.050042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7d8f3-5132-474a-81e1-e666c110d6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.061584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.084632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2bc7d8f3-5132-474a-81e1-e666c110d6df None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:38.086982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2bc7d8f3-5132-474a-81e1-e666c110d6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:38.103228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:38.105383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.107548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.108240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] PATH_INFO: `/v3/users/289b64719aad469e8260668feb1af001` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.128761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] RBAC: Authorizing `identity:get_user(user_id=289b64719aad469e8260668feb1af001)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:38.130261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:38.132740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 54/109] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:37 2022] GET /identity/v3/users/289b64719aad469e8260668feb1af001 => generated 289 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:38.137519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:38.178780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 56/110] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:38.268320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1833-b437-452d-9473-d048778faaf3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:38.295031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.315966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:38.316637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.316895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.317172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.389268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b740-2fb7-4bb4-b4ee-2ddce04a79ec None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.389552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b740-2fb7-4bb4-b4ee-2ddce04a79ec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.389826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2156b740-2fb7-4bb4-b4ee-2ddce04a79ec None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.391180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 57/111] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:38.396102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb59d-480d-4a66-893f-010fa55426fe None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.396409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb59d-480d-4a66-893f-010fa55426fe None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.396691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cffb59d-480d-4a66-893f-010fa55426fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.406004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:38.411500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:38.445536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5cffb59d-480d-4a66-893f-010fa55426fe None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:38.446677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5cffb59d-480d-4a66-893f-010fa55426fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:38.533644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 55/112] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:42:38.534334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:38.562451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.581299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 58/113] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:38.588478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def05e-94a5-48ca-a08d-30c2fcd1a137 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.588478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def05e-94a5-48ca-a08d-30c2fcd1a137 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.588478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86def05e-94a5-48ca-a08d-30c2fcd1a137 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.588478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 59/114] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:38.588478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def05e-94a5-48ca-a08d-30c2fcd1a137 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:38.681457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.719606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c6eac-5ad8-4934-871d-3071fbe2e265 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:38.733650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86def05e-94a5-48ca-a08d-30c2fcd1a137 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:38.771450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:38.771649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:38.772089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.772187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.772370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.772498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.772678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.772769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.773866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:38.776104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2b384-4210-4008-9b41-8baf62a39fa9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:38.777803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 60/115] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:38 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:38.778966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.779252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.779528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:38.784634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:38.790519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:38.791392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:38.792609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 56/116] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:38.793735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:38.805062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:38.806274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:38.876695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 61/117] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:38.877557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:38.901267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.937175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e77f92-a8f4-42c4-ab73-104c1a8fb919 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:38.957868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:38.989428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:38.989996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:38.990282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:38.990635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.007460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e5194-a855-40a4-bdf6-f95d0b83f702 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.014117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:39.020822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:39.021656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:39.022423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:39.024815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 57/118] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:39.026333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.049529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.050342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.050776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.051152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.052041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=289b64719aad469e8260668feb1af001) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:39.052563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.054280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.068634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 62/119] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:38 2022] GET /identity/v3/role_assignments?user.id=289b64719aad469e8260668feb1af001&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=e419d943eb5145d191219eca713a8023 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.068634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.202954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded92d4-c8e4-4555-adb0-a4350d3947a3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.222728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85677b3f-b7ce-43a3-9eb8-120951e62523 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.244841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.245396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.245677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.246028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.246827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:39.247138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.248645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.251506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.254642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.263271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 58/120] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.265398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.272489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.273148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.273435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.273718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.284612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:39.289903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:39.290918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 63/121] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:39.291869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.395603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346a107-ecfe-409a-b3e0-2410d5a0a91c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.425157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def27362-a977-4ce6-873c-3cee1120cec7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.436813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.438064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.438822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.439296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.440321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:39.441208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.443103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.454661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 59/122] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.455974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.461405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.462237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.462762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.463208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.475019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:39.480602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:39.481447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:39.482204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:39.484594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 64/123] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:39.485691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.525260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.536280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.571519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b0818-8b47-4e89-8c2d-7d9779631dab None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.595046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d5cb8-a1ad-49e2-bd1d-e96ddc20a266 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.609767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.610471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.610759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.611038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.612222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.613721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.615495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 60/124] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.616113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.636951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.637942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.638468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.638940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.639859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:39.640441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.642115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.651284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 65/125] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.652481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.728077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a65c5-2c53-4f18-a8ca-1eedbe726165 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.755832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.760039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d52f56-a21b-440b-9fca-0d368637af31 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.766430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.767406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.767831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.768331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.769690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.771299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.771753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:39.773593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 61/126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.774831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.800960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.801596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.801976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.802348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.803141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:39.803549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.805154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.816007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 66/127] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.817029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.884329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564b2dc-e222-4a80-9a02-0d64fba232e1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.921197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.921833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b6ea1-6480-48dc-94f4-4d25f0c86770 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:39.922644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.923100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.923570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.924900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.926647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.928796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 62/128] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.929838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:39.957841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:39.958485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:39.958768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:39.959071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:39.960338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:39.961767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:39.964069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 67/129] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:39.968580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.002697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.006903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.043855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d48e5-521f-4a33-a35e-eb22abf6df15 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.075934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb189ed-6c53-405a-9934-190c09d5d211 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.079957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.080897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.081379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.081860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.083212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.084911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.086755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 63/130] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:40.087743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.116870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.117776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.118055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.118328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.119637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.121219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.123145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 68/131] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:39 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:40.123624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.200903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1521f1-0071-4a65-b425-1ec9cb812215 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.231084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745731ee-dde8-48aa-a6f0-7e1c23b9fb02 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.235437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.239116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.242865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.243781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.244192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.244600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/375655afad124666b85edc0c98a1dce0/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.246669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, user_id=375655afad124666b85edc0c98a1dce0, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.248243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.261302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 64/132] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:40 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/375655afad124666b85edc0c98a1dce0/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:40.262007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.286469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.287136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.287422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.287702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.288956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.291619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.294096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 69/133] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:40 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:40.294817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.409088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b26b9-3865-443b-9e0b-6b63ea4ddeea None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.435418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e1b50-e896-4b87-b925-b0a3de3ade9d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.456931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.457618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.457907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.458191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/375655afad124666b85edc0c98a1dce0/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.461239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, user_id=375655afad124666b85edc0c98a1dce0, role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.463942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd6e4d-1619-47f3-abeb-c81bbc4124d9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.477136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.477780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.478113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.478392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] PATH_INFO: `/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.479560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] RBAC: Authorizing `identity:get_project(project_id=ec2a7e5272e94f8d8680b7a8f1c26564)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.481209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.482299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 65/134] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:40 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/375655afad124666b85edc0c98a1dce0/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:40.483049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 70/135] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:40 2022] GET /identity/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564 => generated 312 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:40.483572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba68a-2046-4e65-8479-b25841f0dba0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.483745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.483896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba68a-2046-4e65-8479-b25841f0dba0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.484256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ba68a-2046-4e65-8479-b25841f0dba0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.485867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 66/136] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:40.490749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ba68a-2046-4e65-8479-b25841f0dba0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:40.535971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.557190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:40.602558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94471833-7e4b-4608-ae54-5375d86e98ab None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.619843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ba68a-2046-4e65-8479-b25841f0dba0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:40.656313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.657226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.657505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/0022827a1ab44829a57581031fab2445/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.659486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, user_id=0022827a1ab44829a57581031fab2445, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.660310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:40.661022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.661124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffed6c1-2011-45d0-9e9c-714e820ce1f5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.661356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.661648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] PATH_INFO: `/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564/users/375655afad124666b85edc0c98a1dce0/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.663769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec2a7e5272e94f8d8680b7a8f1c26564, user_id=375655afad124666b85edc0c98a1dce0, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:40.665293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:40.678602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 71/137] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:40 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/0022827a1ab44829a57581031fab2445/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:40.680086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc844f78-aef7-4067-b9cd-02a2feec0291 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:40.680382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc844f78-aef7-4067-b9cd-02a2feec0291 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:40.680753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc844f78-aef7-4067-b9cd-02a2feec0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:40.687354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 67/138] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:40 2022] PUT /identity/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564/users/375655afad124666b85edc0c98a1dce0/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:40.702571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cc844f78-aef7-4067-b9cd-02a2feec0291 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:40.703905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc844f78-aef7-4067-b9cd-02a2feec0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:40.804720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 72/139] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:41.254094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:41.303857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ecb-d3b9-4a05-ba5d-f56ff4adb3de None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:41.304502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ecb-d3b9-4a05-ba5d-f56ff4adb3de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:41.304502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d1ecb-d3b9-4a05-ba5d-f56ff4adb3de None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:41.305937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 73/140] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:41.310963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:41.311251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:41.311536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:41.330057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:41.331260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:41.360758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:41.389459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042237c3-4361-4263-9789-2752f37e7835 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:41.406302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:41.421735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 74/141] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:41.446482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:41.447601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:41.448168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:41.448677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:41.450797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:41.452501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:41.454311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 68/142] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:41.460082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:41.570769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fe0df-7b57-462a-9616-447f6bc5f30a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:41.611369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:41.612550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:41.613038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:41.613536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:41.614393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:41.616058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:41.652352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 75/143] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:41 2022] POST /identity/v3/users => generated 283 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:41.994521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:42.118120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1617a93-0c61-4511-ac75-26f66e6d46d5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:42.166349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:42.167350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.167830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.168307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.189477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:42.195091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:42.195945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:42.196748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:42.199856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 69/144] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:42.206033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:42.231032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:42.334255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6825d-87f6-4633-a7ee-471d5ad6a7c0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:42.371543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:42.372539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.373024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.373522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.374411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:42.374913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:42.376520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:42.385854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 76/145] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:42.391486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:42.450540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:42.520779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7300c01-bfef-4868-8715-a8a88ac32eb6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:42.562453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:42.563098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.563384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.563659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] PATH_INFO: `/v3/users/289b64719aad469e8260668feb1af001` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.569066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] RBAC: Authorizing `identity:get_user(user_id=289b64719aad469e8260668feb1af001)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:42.570656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:42.572331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 70/146] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:42 2022] GET /identity/v3/users/289b64719aad469e8260668feb1af001 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:42.578017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:42.679180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:42.701404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebcc50-d10d-4861-b25f-b56663e26ee2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:42.743204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:42.743849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.744163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.744468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.745614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:42.747097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a49028d-f8ef-487e-9b27-5f9b086ee0d7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:42.749078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 77/147] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:42 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:42.754599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:42.868875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4854a9-b2d8-493e-b8c1-708f43d98e98 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:42.882129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933292b-0648-42a8-a516-27d636fd5271 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.882414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933292b-0648-42a8-a516-27d636fd5271 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.882731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933292b-0648-42a8-a516-27d636fd5271 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.884377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 78/148] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:42.884878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:42.893389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdeeb-7372-40b6-8bb5-d03cb7ef91f8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.893696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdeeb-7372-40b6-8bb5-d03cb7ef91f8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.893951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fbdeeb-7372-40b6-8bb5-d03cb7ef91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.927124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f6fbdeeb-7372-40b6-8bb5-d03cb7ef91f8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:42.928415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f6fbdeeb-7372-40b6-8bb5-d03cb7ef91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:42.969202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:42.969811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:42.970102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:42.970382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/289b64719aad469e8260668feb1af001/roles/e419d943eb5145d191219eca713a8023` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:42.972445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, user_id=289b64719aad469e8260668feb1af001, role_id=e419d943eb5145d191219eca713a8023)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:42.973948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc82b3b1-4a46-41db-ac0a-a06c471ecb46 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:42.995868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 71/149] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:42 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/users/289b64719aad469e8260668feb1af001/roles/e419d943eb5145d191219eca713a8023 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:42:43.042098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 79/150] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:43.372697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b27e9-ca78-42c9-b2f0-c7d971466442 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:43.373030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b27e9-ca78-42c9-b2f0-c7d971466442 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:43.373205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b27e9-ca78-42c9-b2f0-c7d971466442 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:43.374722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 72/151] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:43.386643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67b45-bb70-4b7e-9195-2c8121d94cd7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:43.387047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67b45-bb70-4b7e-9195-2c8121d94cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:43.387229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf67b45-bb70-4b7e-9195-2c8121d94cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:43.412591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4cf67b45-bb70-4b7e-9195-2c8121d94cd7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:43.413811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4cf67b45-bb70-4b7e-9195-2c8121d94cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:43.486509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 80/152] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:43.551278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b27e9-ca78-42c9-b2f0-c7d971466442 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:43.570490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5197-78be-4b56-a006-55a0ab3e21de None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:43.571361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5197-78be-4b56-a006-55a0ab3e21de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:43.571838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc5197-78be-4b56-a006-55a0ab3e21de None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:43.574707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 81/153] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:43.592627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:43.593584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:43.594347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:43.636967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:43.639904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:43.647486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:43.734101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b27e9-ca78-42c9-b2f0-c7d971466442 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:43.802981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 82/154] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:43.807565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:43.808222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:43.808529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:43.808800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:43.830450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:43.835264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:43.836177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:43.836969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 73/155] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:43.844472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:43.978683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7e137-5c17-4b0f-93a6-e43b6c124c55 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:44.018083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:44.018700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.018997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.019315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.019994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:44.020349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:44.021826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328041d3-8f2e-499f-ac1b-92f7aee5fa87 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:44.029477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:44.034602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 83/156] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:44.040579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:44.052223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555213d7-114a-4c4f-af83-50252fdec0d6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.052527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555213d7-114a-4c4f-af83-50252fdec0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.052810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555213d7-114a-4c4f-af83-50252fdec0d6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.054302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 84/157] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:44.066042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.066321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.066604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.104331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:44.104744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:44.105567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:44.262306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef3867-b0ad-4b5d-8990-13274e34d67f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:44.280964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 85/158] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:44.281933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:44.320715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:44.321478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.321768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.322068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.326723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:44.328210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:44.330039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 74/159] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:44 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:44.335576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:44.478522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:44.490604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b32fa9-a84e-499d-895e-b840a435cd0b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:44.505650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2085-c770-43c4-9349-25cb8f3606c4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:44.576837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:44.590193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:44.590817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.591108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.591401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.597582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:44.598299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:44.598644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:44.598983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:44.633347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:44.638296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:44.639289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:44.640153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 86/160] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:44.644767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:44.764464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:44.766413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:44.909750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:44.922676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 75/161] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:42:44.922934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dc2c35-016e-4de2-9039-cf389a8762fe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:44.923965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.017182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.017783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.018062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.018330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.056766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cff38e-b266-4226-bbe0-51e3d52914c6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.060139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:45.064490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:45.065476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:45.066290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 87/162] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:45.066996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.098322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.099423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.099896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.100353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.101246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:45.101867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.104038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.113542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 76/163] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.114845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.182235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:45.205849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:45.237024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f6c0db-6d01-4b0b-a565-2da64ba42890 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.293718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.294462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.294837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.295187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.313905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:45.320184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:45.321321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:45.322651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:45.325777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f371e1-9d58-40bb-af85-83e5025f11a7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.334056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 77/164] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:45.335075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.425123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.425776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.426151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.426430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.433164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.434579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.436229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 88/165] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.437018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.478801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ddbc8-e8fb-40e8-b96e-39913c39d081 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.497397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:45.521146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.521878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.522166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.522528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.523604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:45.523946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.526462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.536206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 78/166] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.537142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.631213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2cf10-a1a9-4403-8a99-9e65d3aa46f1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.651355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba894a1-2b0d-4fb0-b3a1-271cee08175f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.677531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:45.691798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.692699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.693233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.693662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.694483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:45.694993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.696729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.706938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 79/167] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.708307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.725802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.726502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.726833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.727063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] PATH_INFO: `/v3/users/0022827a1ab44829a57581031fab2445` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.733245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=0022827a1ab44829a57581031fab2445)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.734698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.736366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 89/168] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/users/0022827a1ab44829a57581031fab2445 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.737246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.764059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:45.829013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9324040-d510-406b-a2b5-ada91af03481 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:45.868171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:45.869793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:45.870281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:45.870756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:45.871846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:45.872448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:45.874319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:45.881378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 80/169] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:45.882487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:45.984774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c376bf-cbe9-4bc2-ba48-cdc32dd41fb9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.002098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c10dd4-bc6e-49c2-8adf-6aca13d2cd11 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.011381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.044517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.045573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.046173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.046661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.048203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.050014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.052133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 81/170] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:46.053314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:46.081839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.082499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.082784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.083063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] PATH_INFO: `/v3/users/375655afad124666b85edc0c98a1dce0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.089162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] RBAC: Authorizing `identity:get_user(user_id=375655afad124666b85edc0c98a1dce0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.090629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.092283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 90/171] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:45 2022] GET /identity/v3/users/375655afad124666b85edc0c98a1dce0 => generated 275 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:46.093174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:46.235529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.338651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997a96fc-e416-4fd8-b173-209bdd5b02e9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.362633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174be158-379d-4605-8f92-a7a4b2bc7084 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.431160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.432363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.432667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.432950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.437040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.437834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.438270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.438683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.489015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.519619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.521244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.530720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.533053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3ead53-1bd9-42c8-a957-a28f3f19cba7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.608550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.642650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 82/172] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:46.644122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:46.660466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 91/173] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97409970-9c16-4aae-8448-7651fa676410 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97409970-9c16-4aae-8448-7651fa676410 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97409970-9c16-4aae-8448-7651fa676410 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 92/174] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed666-1cdb-44e4-adce-adfd91ef7db8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.665507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed666-1cdb-44e4-adce-adfd91ef7db8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.666580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aed666-1cdb-44e4-adce-adfd91ef7db8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.668448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 93/175] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:46.668448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3e16-2fe1-42f3-8a0e-f4a0c0fa067c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.668448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3e16-2fe1-42f3-8a0e-f4a0c0fa067c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.668448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea3e16-2fe1-42f3-8a0e-f4a0c0fa067c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.669561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 94/176] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:46.670263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea3e16-2fe1-42f3-8a0e-f4a0c0fa067c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:46.733216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.757716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583761f3-7064-4474-9cf0-ff3711a972ee None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.771016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea3e16-2fe1-42f3-8a0e-f4a0c0fa067c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:46.791469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.792085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.792346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.792641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.804678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:46.805304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.805586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.805861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.807498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.808986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226b684-937c-4c77-bc2e-f7a56b41f66e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.810645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 95/177] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:46 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:46.813762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1685-b2f8-4dc3-bc76-c12343f31b85 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.814049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1685-b2f8-4dc3-bc76-c12343f31b85 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.814328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b1685-b2f8-4dc3-bc76-c12343f31b85 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.815874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 96/178] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:46.817193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.817193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.817399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:46.835359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:46.836613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:46.853885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.864932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:46.866396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9e3c27-a99e-4aed-94f6-eeafef26a1d0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:46.905010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 97/179] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:46.905924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:46.951088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:46.985507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 83/180] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:46.985507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:46.985507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:46.985507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.003562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:47.004765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:47.010171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d479d-3cce-4ec3-8bfa-af088c97cce9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.049501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.050455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.050740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.051167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] PATH_INFO: `/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.052325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] RBAC: Authorizing `identity:get_project(project_id=ec2a7e5272e94f8d8680b7a8f1c26564)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:47.053797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadb91e-6aa8-48d6-87b0-00de25d5e809 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:47.055495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 98/181] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:46 2022] GET /identity/v3/projects/ec2a7e5272e94f8d8680b7a8f1c26564 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:47.058856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464ad3-ae04-4799-8e91-315f87da5157 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.059211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464ad3-ae04-4799-8e91-315f87da5157 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.059549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3464ad3-ae04-4799-8e91-315f87da5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.079348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 84/182] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:47.082293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.090362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a3464ad3-ae04-4799-8e91-315f87da5157 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:47.092234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a3464ad3-ae04-4799-8e91-315f87da5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:47.112005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.180038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 99/183] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:47.181550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.182005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.182427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.195433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8ec279-8dec-4cd6-86be-72d726121cf6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.200000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:47.201204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:47.205235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.244985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.245596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.248783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.249266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.250690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=0022827a1ab44829a57581031fab2445) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:47.251262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:47.254122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:47.268505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 85/184] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/role_assignments?user.id=0022827a1ab44829a57581031fab2445&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:47.269690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.296998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 100/185] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:47.304422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.452791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.462105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56668680-60d4-469f-84b6-197c0e6bad92 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.472793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc3c37-a224-48a4-93f4-b8ff8607f6ae None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.506366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.507356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.507850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.508350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.511023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:47.512760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:47.513892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.514676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.514955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.515227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.516151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 86/186] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:47.516273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=ec2a7e5272e94f8d8680b7a8f1c26564, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:47.516361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:47.516974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.518150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:47.525921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 101/187] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=ec2a7e5272e94f8d8680b7a8f1c26564&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:47.527717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.564001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.649628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fbdb7-5ba2-4c1d-b424-02a3eb882a78 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.691069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b0ee5-556a-432c-8d14-efda42362855 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.694999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.695775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.696179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.696583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.710263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:47.715099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:47.715970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 87/188] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:47.717386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.732309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.732977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.733278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.733528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.745074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:47.750750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:47.751786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 102/189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:47.752885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.759063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.828112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:47.834196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77eadf-ca66-4be0-9486-ce0de5fd749d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.860655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f5c50-05a6-4a17-913d-58b708edabf8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:47.868530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.869809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.870085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.870361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.880328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:47.885074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:47.886033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:47.886823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 88/190] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:47.887479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.897980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:47.898590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:47.898878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:47.899150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:47.899880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=375655afad124666b85edc0c98a1dce0) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:47.900216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:47.901693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:47.907483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 103/191] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/role_assignments?user.id=375655afad124666b85edc0c98a1dce0&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:47.908281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:47.994926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.018713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aca8240-f598-45ec-a367-22ca136cdb93 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.033520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc307bb1-16bf-424c-953e-4a73937ee273 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.060335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.061004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.061285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.061558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.062703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.064245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.065920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 89/192] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.066710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.085091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.085625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.085890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.086162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.086857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:48.087245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.090372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.097024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.100037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 104/193] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.101985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.177923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e742922-6bde-4c58-8689-7b7fb8ae66be None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.210552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01c14f-c659-4f02-ad55-bae5d33e08f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.213865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.214469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.214749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.215009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.215664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:48.215964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.217365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.225786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 90/194] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.226552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.242512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.248911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.249518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.249802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.250074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.250731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:48.251031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.252433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.260635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 105/195] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.266015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.313336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.328710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d539b-db5c-43fb-9a7e-fc18052704cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.361864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.362481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.362761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.363027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.363659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.364061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bf2d9-c6c8-4e37-8f83-3af664a173fe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.365143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.387412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 91/196] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:48 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:48.393438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.405874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.406699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.407078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.407452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.425643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.427277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.433865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 106/197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.433865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.493719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.522929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880daa04-a80a-40c1-af4d-e6a5ddd76e48 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.551958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bcab0-3421-4896-9be4-21a8b1f30247 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.562905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.563557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.563837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.564111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] PATH_INFO: `/v3/users/289b64719aad469e8260668feb1af001` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.565418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] RBAC: Authorizing `identity:get_user(user_id=289b64719aad469e8260668feb1af001)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.566877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.569512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 92/198] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/users/289b64719aad469e8260668feb1af001 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.570329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.584106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.598843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.599518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.599795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.600070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.601305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.602755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.604367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 107/199] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:48.605165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:48.699597 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ade626-6a05-451a-822a-a0c8d868a9da None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.741090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d99e1-3d8b-419d-b0d2-4ba7e9120e94 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:48.743289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.744875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.745152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.745421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.764618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.789494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:48.790113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:48.790391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:48.790686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:48.832841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.834596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.849952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:48.886645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:48.888918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:48.962272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 93/200] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:48.963539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.006679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 108/201] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:49.006679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.022437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.084131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3038c2-24d3-4fa7-ae08-0bbd104f405d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.097039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.106644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f378804-9dd3-4668-bfd9-53edbb2896a5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.125540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.126375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.126903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.127328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.142548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.143186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.143464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.143732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.145009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.146492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.148590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 109/202] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:49.149384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.205461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.207344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.235888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.252128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914838d-0079-4506-843b-cec8a48136a1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.286978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.288118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.288118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.288319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.289327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.291328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.293001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 110/203] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:49.298412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.333919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 94/204] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:49.334978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.347365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.408889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04dc604-9b19-473c-8292-679ce7d5ffe0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.444589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.445378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.445589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.445873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.446582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=4e119effacc144d1ab830c20aefd6caa) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:49.446917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.448237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ff1652-7670-4dad-9d1d-ca955618f530 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.448354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.455025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 111/205] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/role_assignments?user.id=4e119effacc144d1ab830c20aefd6caa&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:49.455751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.476611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.500303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.501192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.501617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.502059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.503045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24, user.id=289b64719aad469e8260668feb1af001) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:49.503499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.509488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.517030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 95/206] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/role_assignments?user.id=289b64719aad469e8260668feb1af001&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=e419d943eb5145d191219eca713a8023 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:49.571977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f596aed3-e269-45f2-a288-1090416ee751 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.611228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.611894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.612175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.612480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.613719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.615207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4467d773-614c-4093-9df7-f95d4a8eb7a2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.617417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 112/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:49.623752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:49.735433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:49.765804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d0eac-8f87-4d30-b18e-3703e831d50c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:49.806545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:49.807168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:49.807454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:49.807729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:49.808631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=4e119effacc144d1ab830c20aefd6caa) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:49.808796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:49.810246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d89b6-b448-40da-9873-d0407e801131 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:49.816458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 96/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:49 2022] GET /identity/v3/role_assignments?user.id=4e119effacc144d1ab830c20aefd6caa&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:50.540133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8d1d-7ffd-4770-b699-0dd923d0764e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:50.541208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8d1d-7ffd-4770-b699-0dd923d0764e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:50.541692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8d1d-7ffd-4770-b699-0dd923d0764e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:50.543540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 113/209] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:50.549247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:50.550142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:50.550618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:50.569970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:50.571481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:50.618594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e3d5-a9ee-4539-a75e-8324e88d900d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:50.619462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e3d5-a9ee-4539-a75e-8324e88d900d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:50.619699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550e3d5-a9ee-4539-a75e-8324e88d900d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:50.621610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 114/210] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:50.627033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:50.627552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:50.628068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:50.646721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 97/211] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:50.648098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:50.649551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:50.722659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 115/212] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:50.922357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:50.993930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.019382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.031763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68e640-5988-4235-b925-b4e32e16ef5f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.043387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.077492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.078133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.078414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.078687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.090517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:51.095460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:51.096377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:51.097209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 98/213] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:51.102307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.173606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc0dbf-dd4c-422b-b449-bf686faf0ea5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.213516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.214225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.214663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.215106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.216423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:51.217806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:51.219477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 116/214] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:51.219880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127099-471d-41ba-bfae-8d5ecb1910cb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.228800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.258402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.269925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.270546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.270831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.271101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.272265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:51.272607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:51.274766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:51.288028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 99/215] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:51.294929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.322448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.340624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09eda8-901f-45d6-9bf1-67ef3def2a22 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.379623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.380670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.381142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.381584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.382883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:51.384917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:51.420477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 117/216] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:51 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:51.441283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209afcf9-99f4-44c0-b7fe-aefdd5aa6aa3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.481660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.482609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.483120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.483395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] PATH_INFO: `/v3/users/0488145e5ba64088abefa0ee3390ea62` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.499679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] RBAC: Authorizing `identity:get_user(user_id=0488145e5ba64088abefa0ee3390ea62)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:51.501198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1960e1-080c-4987-a353-e50086a80de4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:51.503286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 100/217] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:51 2022] GET /identity/v3/users/0488145e5ba64088abefa0ee3390ea62 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:51.510340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.620409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f76f2-9807-4d37-9955-db8ebd8fd787 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:51.631020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bce1a-27b4-44cf-abd6-757b65eadd0a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.631487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bce1a-27b4-44cf-abd6-757b65eadd0a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.631561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bce1a-27b4-44cf-abd6-757b65eadd0a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.633931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 101/218] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:51.639748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9ffa-12a6-4ae2-8d89-61a904c28755 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.640029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9ffa-12a6-4ae2-8d89-61a904c28755 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.640307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d9ffa-12a6-4ae2-8d89-61a904c28755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.661870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5e9d9ffa-12a6-4ae2-8d89-61a904c28755 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:51.663068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:51.663703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.663806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5e9d9ffa-12a6-4ae2-8d89-61a904c28755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:51.663982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.664260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.677075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.718159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.752112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 102/219] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:51.755276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:51.755276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:51.820752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ed7b-e71d-4d25-8768-deb083556fa4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.821397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ed7b-e71d-4d25-8768-deb083556fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.822520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440ed7b-e71d-4d25-8768-deb083556fa4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.824089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 103/220] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:51.829540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c92ff-adb3-4385-b448-27340df68407 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:51.830091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c92ff-adb3-4385-b448-27340df68407 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:51.830550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700c92ff-adb3-4385-b448-27340df68407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:51.852665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-700c92ff-adb3-4385-b448-27340df68407 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:51.853898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-700c92ff-adb3-4385-b448-27340df68407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:51.865864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 118/221] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:51.873448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:51.920727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:51.960534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 104/222] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:51.985196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325bdd8-b228-4958-affd-deded38809eb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.021341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.022067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.022416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.022760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.023968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.025659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.027805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 119/223] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:51 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:52.033728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c92ff-adb3-4385-b448-27340df68407 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.045256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.231019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700c92ff-adb3-4385-b448-27340df68407 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.241214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b88b6b-a73b-4b9b-a09c-87655d20fb6c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.250918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:52.256069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:52.289788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.290429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.291285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.291566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.293308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.294310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.295094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.295555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.296580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=0488145e5ba64088abefa0ee3390ea62) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:52.297371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.299177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.303443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:52.306274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 105/224] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/role_assignments?user.id=0488145e5ba64088abefa0ee3390ea62&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:52.307832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:52.316006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:52.317255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 120/225] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:52.318055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.477659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2e95a-38a8-4358-8447-65578c9e2160 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.514575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.515134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.515417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.515692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.517675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db168-ff4e-4c1f-a52b-b59d30dce57b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.526929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:52.533758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:52.534613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:52.535403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 106/226] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:52.543913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.561024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.561641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.562219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.562496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.563644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:52.564099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.566075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.577496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 121/227] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:52.585377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.586090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:52.646563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:52.663911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd68d6e-f8d5-4cb6-9b10-604071bd1fb4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.703181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.704225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.704839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.705283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.706281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:52.706749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.708667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.718618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 107/228] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:52.725267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.835911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74747d4c-6477-450a-87e9-3780f53173be None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.848352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea602af3-0a5a-4a07-b27b-adf360d86676 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:52.871860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:52.883272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.883966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.884882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.885233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.893197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.894710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.899484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 108/229] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:52.902912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:52.926579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:52.927239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:52.927519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:52.928119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:52.930527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:52.933151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:52.937037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 122/230] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:52.949776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:53.102935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56e0c4-b961-4390-811a-2fd838f131db None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:53.139702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:53.147019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f69d7d-6a7c-42fa-8f41-edd6c7c68dca None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:53.175667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:53.176785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.177640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.178898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.183886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:53.185605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:53.187701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 109/231] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:53.197820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:53.206155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:53.206850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.207132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.207404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.208629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:53.210092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:53.212080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 123/232] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:52 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:53.218502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:53.265324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:53.374244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258c2eaa-a562-403a-9776-021efd729784 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:53.423203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea71f1-a392-4ce1-8617-36710607fe8b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:53.463644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:53.465202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.465694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.466287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/4e119effacc144d1ab830c20aefd6caa/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.468742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, user_id=4e119effacc144d1ab830c20aefd6caa, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:53.470660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a8130-77a2-4f66-8cf6-72b02c07ea23 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:53.484743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:53.485502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.485786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.486067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/4e119effacc144d1ab830c20aefd6caa/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.489206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 110/233] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:53 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/4e119effacc144d1ab830c20aefd6caa/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:42:53.494303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, user_id=4e119effacc144d1ab830c20aefd6caa, role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:53.495817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef4c29-7f5a-493d-a40c-d3942fc8fb93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:53.523381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 124/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:53 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/4e119effacc144d1ab830c20aefd6caa/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:42:53.848888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7a77-1b96-4b60-84be-a737009a5c84 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.849903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7a77-1b96-4b60-84be-a737009a5c84 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.850391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7a77-1b96-4b60-84be-a737009a5c84 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.852189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 111/235] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:53.857931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.858380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.858601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.880578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:53.881778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:53.903332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7edaa-6a4e-4e99-ace9-df29f5a3a510 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.903975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7edaa-6a4e-4e99-ace9-df29f5a3a510 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.904413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7edaa-6a4e-4e99-ace9-df29f5a3a510 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.906132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 112/236] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:53.914794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:53.915327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:53.916325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:53.916904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:53.957901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:53.959124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:54.007861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 125/237] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:54.050430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 113/238] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:54.355317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:54.395122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:54.428479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:54.520145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d1334-8aa7-4aab-a65d-ce65cf721964 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:54.598116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675b8e4-2500-4ef7-badc-d7e1ea61aa01 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:54.612478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:54.613041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.613323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.613593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.633950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:54.640111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:54.641070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:54.641857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:54.648585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 126/239] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:54.659850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:54.684787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:54.685399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:54.686315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.686593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.686862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.688047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:54.689663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:54.692153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 114/240] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:54.698035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:54.786751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a2ca1-2f5e-47ab-be80-d102c73bf6e2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:54.800471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:54.814172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5afb95-ba7a-4555-a325-71583d1d71b7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:54.826796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:54.827711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.828176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.828659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.829643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:54.830154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:54.831837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e3823-3482-4675-8246-1aac4e14f959 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:54.842315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 127/241] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:54.848474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c40-0a92-4797-aad7-9561c2687f1c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.849010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c40-0a92-4797-aad7-9561c2687f1c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.849468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5c40-0a92-4797-aad7-9561c2687f1c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.850962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 128/242] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:54.851903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5c40-0a92-4797-aad7-9561c2687f1c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:54.857443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:54.858070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.858351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.858623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.859296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:54.860768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece6d41-b335-4c5b-af21-89df42b3640e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:54.886213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 115/243] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:54 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:54.892201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:54.892201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:54.892201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:54.909980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:54.911317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:54.987757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:54.999130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 116/244] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:55.036619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5c40-0a92-4797-aad7-9561c2687f1c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.081387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.082411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.082919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.083439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] PATH_INFO: `/v3/users/b02741f6065c4bd697ec7b8dd7575d4e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.105340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] RBAC: Authorizing `identity:get_user(user_id=b02741f6065c4bd697ec7b8dd7575d4e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:55.107139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:55.109156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 129/245] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:54 2022] GET /identity/v3/users/b02741f6065c4bd697ec7b8dd7575d4e => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:55.115115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.210882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:55.240093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06372e8-a4a0-46a7-9f9a-b3e76b92e14c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.282722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.283727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.284233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.284729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.346567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.375239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:55.377201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:55.486215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:55.488361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7ce737-d97a-437f-8520-e53446584877 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.514700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 117/246] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:42:55.520197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.529657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.530298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.530575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.530850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.533744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:55.545595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:55.551095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:55.552009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:55.552847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 130/247] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:55.559666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.630654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f465617-a7f4-4776-981b-588ba9db40fe None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.672683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.673040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bf3808-c2aa-4218-90ee-0ae859079ffb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.673329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.673612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.673883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.675193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:55.677378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:55.684114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 118/248] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:55.693447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.727806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.729512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.730490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.730970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.732127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:55.732845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:55.735188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:55.754468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 131/249] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:55.760075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:55.776424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:55.870493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2441f4d8-d578-4fcf-8bac-66957ac075cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:55.878086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:55.908139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:55.908779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.909060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.909333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.910222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=b02741f6065c4bd697ec7b8dd7575d4e) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:55.910529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:55.912093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec17705-1d57-456f-85bd-cc859c380dd7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:55.918507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 119/250] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/role_assignments?user.id=b02741f6065c4bd697ec7b8dd7575d4e&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=e419d943eb5145d191219eca713a8023 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:55.919812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9104-ff82-48d7-8378-355dc6989c48 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.920104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9104-ff82-48d7-8378-355dc6989c48 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.920376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f9104-ff82-48d7-8378-355dc6989c48 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.922032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 120/251] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:55.927866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:55.928165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:55.928434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:55.948360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:55.949793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:55.960839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d4c5a-ac4a-4e08-bd42-e11afca7d7f8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.024029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 121/252] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:56.029841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:56.031258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.031749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.032246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] PATH_INFO: `/v3/users/0488145e5ba64088abefa0ee3390ea62` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.033815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] RBAC: Authorizing `identity:get_user(user_id=0488145e5ba64088abefa0ee3390ea62)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:56.035493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf025c-a8e5-4ed4-93b0-8e7dd39db154 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:56.037371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 132/253] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:55 2022] GET /identity/v3/users/0488145e5ba64088abefa0ee3390ea62 => generated 297 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:56.043784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.097178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:56.145059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568d33-4a10-4538-8e6e-43ae679a3b86 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.145377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568d33-4a10-4538-8e6e-43ae679a3b86 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.145617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f568d33-4a10-4538-8e6e-43ae679a3b86 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.147198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 133/254] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:56.154489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.154786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.155019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.177022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:56.178242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:56.213651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd75af-5309-401a-bc2d-0ef5cdc46a76 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.281698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:56.281698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.281698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.281698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.282858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:56.286162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:56.286162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 122/255] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:56 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:56.291621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.313697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 134/256] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:56.383788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.442671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c58539-cf2c-4287-87e9-58a3b9bb820b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.446120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:56.491300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:56.492284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.492594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.494719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/0488145e5ba64088abefa0ee3390ea62/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.497219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, user_id=0488145e5ba64088abefa0ee3390ea62, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:56.498668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:56.522131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 123/257] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:42:56 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/0488145e5ba64088abefa0ee3390ea62/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:42:56.530139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:56.589759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af193a-5e3c-4c3b-8adf-9de0013ddf2e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.635080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:56.635748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.636081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.636359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.648286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:56.653451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:56.654386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:56.655500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 135/258] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:56.660682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.764305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.790210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685d9a2-0c2d-4457-8341-138cb18e0374 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.834470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:56.835531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:56.836003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:56.836481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:56.837738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:56.838053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:56.839466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:56.850084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 124/259] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:56.855847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:56.891085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:56.951424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f3db7-b34d-476d-b918-1c1cea93661a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.983843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24d038-4723-4ac5-abcf-ada9aa586ca5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:56.984587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:57.020586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.021187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.021310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.021525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.021775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.021876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.022094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.022369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.023579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.025713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.029020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 125/260] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:56 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:57.034142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.051454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:57.060179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:57.061124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:57.062588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 136/261] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:42:57.067141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.222716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:57.230057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839b66c9-30b3-4f43-9595-9858a1c03325 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:57.272211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec01d10-2f0e-41af-998d-a0633679a633 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:57.288359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.289114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.289400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.289674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.352544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.353819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.354103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.354377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.355065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:57.355369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.356845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.378952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 137/262] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:57.384996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.441527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.442180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:57.443734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.533204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608f698-4122-4b76-8a85-0112378a7b97 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:57.601683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.602336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.602618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.602926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] PATH_INFO: `/v3/users/4e119effacc144d1ab830c20aefd6caa` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.604102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] RBAC: Authorizing `identity:get_user(user_id=4e119effacc144d1ab830c20aefd6caa)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.605594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.607505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 138/263] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/users/4e119effacc144d1ab830c20aefd6caa => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:57.612950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.687806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:57.699441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 126/264] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:42:57.704709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.717658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e93de1-1f3d-436e-b9d4-0a594f5e5118 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:57.732747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:57.761506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.762290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.762684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.763120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.833092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.834734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.855615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38267832-9c27-44bf-9f06-db01b89f447e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:57.917962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:57.918768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:57.918989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:57.919266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:57.921089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:57.922677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:57.924562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 127/265] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:57.929999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:57.985043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 139/266] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:42:57.992254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:58.003197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:58.039205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:58.095277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be22102c-5458-448b-838f-845d28ab0583 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:58.120433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd719d-2e7a-4b5d-8117-d7f8cb077aa8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:58.144995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:58.145972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.146430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.146904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.148236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:58.149931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d503-7dcf-48b4-96a6-b4d9820a5b48 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:58.152093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 140/267] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:58.158046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d04-14fa-4e18-b979-b2a8dc527490 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.158672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d04-14fa-4e18-b979-b2a8dc527490 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.159137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1900d04-14fa-4e18-b979-b2a8dc527490 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.160701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 141/268] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:58.161635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900d04-14fa-4e18-b979-b2a8dc527490 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:58.194280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:58.195056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.195293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.195562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.196293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=4e119effacc144d1ab830c20aefd6caa) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:58.196670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:58.198100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b126f-5c19-4cb1-ae57-ebc93481f9b8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:58.210998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 128/269] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:57 2022] GET /identity/v3/role_assignments?user.id=4e119effacc144d1ab830c20aefd6caa&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:58.213387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881f1c-6ab2-4a97-9e91-8729d2f2a8b9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.213671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881f1c-6ab2-4a97-9e91-8729d2f2a8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.213972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c881f1c-6ab2-4a97-9e91-8729d2f2a8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.253912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:58.254144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0c881f1c-6ab2-4a97-9e91-8729d2f2a8b9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:58.255379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0c881f1c-6ab2-4a97-9e91-8729d2f2a8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:58.281764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1900d04-14fa-4e18-b979-b2a8dc527490 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:58.319442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:58.320344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.320793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.321207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.322131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=4e119effacc144d1ab830c20aefd6caa) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:58.322585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:58.324241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:58.330964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 142/270] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:42:58 2022] GET /identity/v3/role_assignments?user.id=4e119effacc144d1ab830c20aefd6caa&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:58.391902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 129/271] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:58.756522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:58.853788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dd60-e3fd-4044-be8e-c3811d60135d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.854132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dd60-e3fd-4044-be8e-c3811d60135d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.854342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e5dd60-e3fd-4044-be8e-c3811d60135d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.855981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 130/272] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:42:58.862636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.862636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.863002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.876929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0618a1f-ce3f-4b67-804d-b0e45ce813bd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:58.890786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:58.892092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:58.917861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:58.918965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.919246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.919521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.920694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:58.922159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a9b18-e5c8-4359-afe4-cacdef21c599 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:58.924035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 143/273] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:42:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:58.925290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c7df-6e7a-456e-97b6-305f9f070506 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.925570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c7df-6e7a-456e-97b6-305f9f070506 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.925843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48c7df-6e7a-456e-97b6-305f9f070506 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.927051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 144/274] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:58.932851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:58.933136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:58.933410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:58.948195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:58.954649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:58.956032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:58.960036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:58.979744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 131/275] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:58.984461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.048945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 145/276] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:42:59.110084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8096c6e-8ec5-49b0-b7b2-4bd49faab363 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:59.153781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:59.154688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.155135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.155562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.156359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:59.158047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:59.204962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 132/277] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:42:58 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:42:59.332043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.363996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.441749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:59.471314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e071f-92ac-4c1f-b715-511e048853a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:59.527231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:59.528081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.528194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.528785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.537179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:59.538990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fb334-5272-44cc-9c61-6ba49ad8ad5c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:59.554720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a5aedd5d-2bbd-47fc-878e-9289ab01eae0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:59.563476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:59.564487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:42:59.565320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 146/278] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:42:59.566014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5817de3-d055-412d-84c8-47aff929dd39 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.566085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5817de3-d055-412d-84c8-47aff929dd39 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.566731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5817de3-d055-412d-84c8-47aff929dd39 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.570283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 147/279] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:42:59.573615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5817de3-d055-412d-84c8-47aff929dd39 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.607752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:59.608819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.610175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.610667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.628715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-20f2163f-da48-4ace-96f9-0ba471c2e86c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:42:59.635963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:42:59.636916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:42:59.637688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 133/280] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:42:59.639084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.639084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.639084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.661948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:42:59.668427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:42:59.729501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5817de3-d055-412d-84c8-47aff929dd39 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:59.768680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:59.769304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.769588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.769870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.770611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:59.770919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:59.772419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:59.772674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 134/281] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:42:59.773540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.792586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 148/282] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:42:59.797916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:42:59.815560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:59.900479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1ed44-4c6f-48cb-850a-ee8c77d3e968 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:42:59.930084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:42:59.943298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:42:59.944286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:42:59.944829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:42:59.945723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:42:59.946960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:42:59.947495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:42:59.949378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:42:59.959967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 135/283] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:42:59.968918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.038507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a27eb2-f14c-48fc-9fc0-da54dac12027 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.069200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:00.077651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e7e31-24c1-472e-a956-9c6a7b058bed None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.116318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.117297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.117627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.117902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] PATH_INFO: `/v3/users/b02741f6065c4bd697ec7b8dd7575d4e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.119086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.119223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] RBAC: Authorizing `identity:get_user(user_id=b02741f6065c4bd697ec7b8dd7575d4e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.120105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.120614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.120814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.121279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] PATH_INFO: `/v3/users/f5153064a1c745b181124ed2586bdbb1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.122299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 136/284] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/users/b02741f6065c4bd697ec7b8dd7575d4e => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:00.123082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.137015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] RBAC: Authorizing `identity:get_user(user_id=f5153064a1c745b181124ed2586bdbb1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.138882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.141120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 149/285] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:42:59 2022] GET /identity/v3/users/f5153064a1c745b181124ed2586bdbb1 => generated 293 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:00.144448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.247978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39e846-9a81-4d00-94a7-fc7eb9bdcd50 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.261436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828f361c-35f1-4eb7-8a7f-2e7a44110e41 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.283479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:00.291971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.292963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.293416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.293847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.303793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.304426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.304708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.304977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.305906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:00.306371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.307793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.310162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 150/286] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:00.310923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:00.312977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:00.314081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:00.314965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:00.317060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 137/287] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:00.323209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.350854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:00.438191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f84f6-0997-44cc-a8c2-683f31bf50cc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.443526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4ad70-d025-4832-bf0b-3b261b486bdb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.484051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.484862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.485369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.485580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.485866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.486142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/b02741f6065c4bd697ec7b8dd7575d4e/roles/e419d943eb5145d191219eca713a8023` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.486529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.487009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.487922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, user.id=f5153064a1c745b181124ed2586bdbb1, scope.system=all) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:00.488094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, user_id=b02741f6065c4bd697ec7b8dd7575d4e, role_id=e419d943eb5145d191219eca713a8023)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.488595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.489569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.490455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.497968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 151/288] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/role_assignments?user.id=f5153064a1c745b181124ed2586bdbb1&scope.system=all&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:00.499242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.506427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 138/289] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:00 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/users/b02741f6065c4bd697ec7b8dd7575d4e/roles/e419d943eb5145d191219eca713a8023 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:00.565243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:00.630738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36036cc-825a-4d64-aef1-6846b1cbea45 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.680487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.681420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.681850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.682277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.683103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:00.683551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.685139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.701455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 152/290] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:00.707462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:00.813167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:00.833653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a37abf0-423a-4c74-afe2-524ec44f18c2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:00.869327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:00.869966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:00.870243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:00.870519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] PATH_INFO: `/v3/users/0488145e5ba64088abefa0ee3390ea62` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:00.871722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] RBAC: Authorizing `identity:get_user(user_id=0488145e5ba64088abefa0ee3390ea62)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:00.873257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:00.875142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 139/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/users/0488145e5ba64088abefa0ee3390ea62 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:00.880763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:01.011065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca2b9c-379b-4f09-b0d7-7c5802c73b9e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:01.021959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:01.056979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:01.057656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.057987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.058266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:01.153058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:01.282744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 153/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:01.288756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:01.431705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b63a94-5543-4be4-9f58-d9123d00c50d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:01.473094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:01.473728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.474009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.474283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.481057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:01.482537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a456c25-262c-4b58-b2ec-539855645359 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:01.484579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 140/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:01 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:01.490137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:01.512302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:01.661974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845f12d-1d7e-463d-9cb9-69d38ca824ea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:01.662214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551b3-4ef4-4c0f-83c4-467ccf830f59 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.662564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551b3-4ef4-4c0f-83c4-467ccf830f59 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.662661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67551b3-4ef4-4c0f-83c4-467ccf830f59 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.665090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 141/294] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:01.670303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.670589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.670872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.705003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:01.707497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:01.718267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:01.718881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.719159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.719430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.720225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=0488145e5ba64088abefa0ee3390ea62) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:01.720568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:01.722128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007bcd5-b35d-4dc1-a214-c6859bcd7a20 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:01.728701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:01.730640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 154/295] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:01 2022] GET /identity/v3/role_assignments?user.id=0488145e5ba64088abefa0ee3390ea62&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:01.734349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a7c0-eb67-406d-9288-68ee305957d2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.734652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a7c0-eb67-406d-9288-68ee305957d2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.734921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d3a7c0-eb67-406d-9288-68ee305957d2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.736268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 155/296] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:01.753814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:01.754125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:01.754351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:01.776551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:01.777775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:01.859852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 156/297] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:01.903032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 142/298] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:02.145423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.149576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:02.197127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.276597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b84e9-1bc4-4906-8ecd-82f7a016fb86 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.313447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.314486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.314994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.315462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.316971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:02.318618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:02.319435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fceb925-2161-451f-abfa-ac38e3422d03 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.321468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 157/299] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:02.327210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.359489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.360244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.360555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.360824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.372219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:02.377913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:02.378974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:02.379882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:02.380506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 143/300] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:02.385981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.398150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:02.417242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:02.449130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185eae3-b255-4e00-ac25-a9bb59aaafbd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.487149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.488029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.488608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.489020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.489891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:02.491473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:02.508429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a8199-9762-4454-84f4-6bba26f9bab1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.516674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 158/301] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Aug 25 02:43:02 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:02.554911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331024fa-8b50-4124-983b-950606962ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.555599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331024fa-8b50-4124-983b-950606962ded None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.556545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331024fa-8b50-4124-983b-950606962ded None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.556824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331024fa-8b50-4124-983b-950606962ded None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.557558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331024fa-8b50-4124-983b-950606962ded None admin] RBAC: Adding query filter params (name=reader) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:02.557864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331024fa-8b50-4124-983b-950606962ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:02.559396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331024fa-8b50-4124-983b-950606962ded None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:02.570247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 144/302] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:02.576225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.690456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b748d-6e8a-42e5-b909-a51c52c376b7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.721745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:02.727429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.728955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.729235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.729510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] PATH_INFO: `/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.745748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] RBAC: Authorizing `identity:get_user(user_id=c92c4ff9f0fd4a55b53a18ae4adc6798)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:02.747285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3145cd23-4018-456c-ba53-caf5d5305d4b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:02.749393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 159/303] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:02 2022] GET /identity/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:02.755135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331024fa-8b50-4124-983b-950606962ded None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:02.787887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bb3a-5709-4c67-bfdc-7eb6a4d2093a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.788469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bb3a-5709-4c67-bfdc-7eb6a4d2093a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.788914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491bb3a-5709-4c67-bfdc-7eb6a4d2093a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.791280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 160/304] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:02.796998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286016-bb6d-48e2-a296-d70ffee2eb8c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.797524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286016-bb6d-48e2-a296-d70ffee2eb8c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.798101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48286016-bb6d-48e2-a296-d70ffee2eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.817818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-48286016-bb6d-48e2-a296-d70ffee2eb8c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:02.819472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-48286016-bb6d-48e2-a296-d70ffee2eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:02.879935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331024fa-8b50-4124-983b-950606962ded None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:02.887504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:02.903512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 161/305] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:02.926930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:02.927543 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:02.927828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:02.928103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:02.928867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, user.id=c92c4ff9f0fd4a55b53a18ae4adc6798, scope.system=all) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:02.929175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:02.930777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ed81-f5cc-424e-8a3b-3ac0ac058099 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:02.937138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 145/306] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Aug 25 02:43:02 2022] GET /identity/v3/role_assignments?user.id=c92c4ff9f0fd4a55b53a18ae4adc6798&scope.system=all&role.id=e419d943eb5145d191219eca713a8023 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:03.028301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01564-2e88-4dcb-829a-c9ba00dea8da None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.028615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01564-2e88-4dcb-829a-c9ba00dea8da None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.028816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd01564-2e88-4dcb-829a-c9ba00dea8da None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.030188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 162/307] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:03.035904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.036242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.036488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.061377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:03.062945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:03.138628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 146/308] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:03.175506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01564-2e88-4dcb-829a-c9ba00dea8da None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.284889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd01564-2e88-4dcb-829a-c9ba00dea8da None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.307075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:03.324980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.325680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.325960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.326232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.337996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:03.343000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:03.343879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:03.344901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 163/309] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:03.351889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.422208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.429508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:03.489387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1035ae-2a81-4bcd-a889-6bd803f4188d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.536373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.536936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.537243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.538082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.539087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:03.539447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:03.541214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:03.552508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 147/310] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:03.558440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.564873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38500aee-8e6c-4245-9e36-4f309e0e108c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.608205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.609229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.609705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.610168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.622310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:03.627834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:03.628797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:03.629600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:03.631982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 164/311] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:03.642170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.688146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c39ff-47f4-4e5d-b521-e9a4b8461677 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.716714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:03.733554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:03.748487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.749524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.749985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.750492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] PATH_INFO: `/v3/users/f5153064a1c745b181124ed2586bdbb1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.752319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f5153064a1c745b181124ed2586bdbb1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:03.754818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:03.757954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 148/312] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/users/f5153064a1c745b181124ed2586bdbb1 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:03.769689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.815019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f41dd10-e665-46f9-a87a-a2167c8c761f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.867269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.868766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.869332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.869796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.870693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:03.871207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:03.873495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:03.890282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 165/313] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:03.893065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:03.910160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2a01d-1abd-467d-b411-c4835b7032b8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:03.951241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:03.951917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:03.952199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:03.952798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] PATH_INFO: `/v3/system/users/f5153064a1c745b181124ed2586bdbb1/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:03.954020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f5153064a1c745b181124ed2586bdbb1, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:03.955524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:03.967652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 149/314] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Aug 25 02:43:03 2022] PUT /identity/v3/system/users/f5153064a1c745b181124ed2586bdbb1/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:04.026812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd794-40ac-47c7-9dec-d2013616755b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:04.029171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:04.070492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:04.072382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.072892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.073388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] PATH_INFO: `/v3/users/b02741f6065c4bd697ec7b8dd7575d4e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.074917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] RBAC: Authorizing `identity:get_user(user_id=b02741f6065c4bd697ec7b8dd7575d4e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:04.076639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:04.078899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 166/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:03 2022] GET /identity/v3/users/b02741f6065c4bd697ec7b8dd7575d4e => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:04.085703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:04.160037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:04.216577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93669c44-666f-41ad-80d6-aa6bb5acaa10 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:04.255263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:04.256275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.256805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.257271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.338106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:04.339617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef98b5-f956-4139-94df-0be4e0e2594e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:04.412443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:04.451434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 150/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:04.457086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:04.582204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76bb8ca-b9a2-4f1e-8a92-c1afb2958059 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:04.604965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923163-8a9b-4a1f-8828-f7e97bad9993 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.605576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923163-8a9b-4a1f-8828-f7e97bad9993 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.606063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87923163-8a9b-4a1f-8828-f7e97bad9993 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.607910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 151/317] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:04.613627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b30476-e994-4283-ae51-36fa3450c89f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.614204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b30476-e994-4283-ae51-36fa3450c89f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.614700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b30476-e994-4283-ae51-36fa3450c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.624559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:04.625562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.626031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.626495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.628334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:04.630900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:04.634138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 167/318] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:04 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:04.643039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-13b30476-e994-4283-ae51-36fa3450c89f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:04.643265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:04.645692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-13b30476-e994-4283-ae51-36fa3450c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:04.712769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:04.772736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 152/319] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:04.818434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320bd36-cad2-4283-974c-eb32fad5d7a2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:04.878669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:04.881195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:04.883611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:04.884625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:04.887189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764, user.id=b02741f6065c4bd697ec7b8dd7575d4e) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:04.888226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:04.890953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce420008-7f6f-47e9-b477-9a1d9c8d69b5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:04.901989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 168/320] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:04 2022] GET /identity/v3/role_assignments?user.id=b02741f6065c4bd697ec7b8dd7575d4e&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=e419d943eb5145d191219eca713a8023 => generated 608 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:05.076185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea8f3b-b15f-4ea5-89ab-df840769370f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.076745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea8f3b-b15f-4ea5-89ab-df840769370f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.076745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea8f3b-b15f-4ea5-89ab-df840769370f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.078118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 153/321] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:05.084653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.085122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.085603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.115976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:05.118231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:05.231799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 169/322] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:05.256969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea8f3b-b15f-4ea5-89ab-df840769370f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:05.342732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:05.355674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea8f3b-b15f-4ea5-89ab-df840769370f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:05.393946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:05.394579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.394859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.395131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.396224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:05.397708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:05.399481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 154/323] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:05.405486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:05.436675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:05.506918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72b7d9-daee-42d6-bcc6-9298387d5e9f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:05.509823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:05.543905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:05.544551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.544827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.545100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] PATH_INFO: `/v3/groups` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.545719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:05.547162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:05.565094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 170/324] 10.222.0.64 () {60 vars in 1134 bytes} [Thu Aug 25 02:43:05 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:05.622319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0cd7b-9061-45cf-82b0-4938c16be098 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:05.660241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:05.660917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.661190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.661458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.673656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:05.678552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:05.679496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:05.681831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 155/325] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:05.686656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:05.789590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:05.800648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd95c69-6bf3-47d4-82f5-b48e76cce180 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:05.839576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:05.840194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:05.840504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:05.840784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:05.841459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:05.841765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:05.843156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5dd9c-1f33-4de3-9dcd-adb3cb1c8510 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:05.852347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 171/326] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:05.859222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:05.881102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:05.976050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611cbf0b-ec3b-4b91-853a-5ff4f61896d9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:06.005087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab8d8-28ca-4185-9156-4a05ed19193b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.005314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab8d8-28ca-4185-9156-4a05ed19193b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.005488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaab8d8-28ca-4185-9156-4a05ed19193b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.008003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 172/327] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:06.012535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57559890-d770-4c24-9bba-84079d55426e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.012813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57559890-d770-4c24-9bba-84079d55426e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.013083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57559890-d770-4c24-9bba-84079d55426e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.015474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:06.016222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.016534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.016808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] PATH_INFO: `/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.017960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] RBAC: Authorizing `identity:get_user(user_id=c92c4ff9f0fd4a55b53a18ae4adc6798)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:06.019406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:06.021385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 156/328] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:05 2022] GET /identity/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:06.027386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:06.041812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-57559890-d770-4c24-9bba-84079d55426e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:06.043088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-57559890-d770-4c24-9bba-84079d55426e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:06.132511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 173/329] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:06.136342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:06.154363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c14e-87b1-4d20-98ec-9e46edf121f9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:06.191350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:06.192006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.192285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.192585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] PATH_INFO: `/v3/system/users/c92c4ff9f0fd4a55b53a18ae4adc6798/roles/e419d943eb5145d191219eca713a8023` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.193982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c92c4ff9f0fd4a55b53a18ae4adc6798, role_id=e419d943eb5145d191219eca713a8023)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:06.195467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:06.205310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 157/330] 10.222.0.64 () {58 vars in 1334 bytes} [Thu Aug 25 02:43:06 2022] PUT /identity/v3/system/users/c92c4ff9f0fd4a55b53a18ae4adc6798/roles/e419d943eb5145d191219eca713a8023 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:06.424223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57559890-d770-4c24-9bba-84079d55426e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:06.531498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:06.549678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57559890-d770-4c24-9bba-84079d55426e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:06.603530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:06.604182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.604485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.604763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.619023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:06.623827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:06.624717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:06.625918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 174/331] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:06.632760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:06.754190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616cd9c-cd82-4dd5-b8f9-698428d9ec15 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:06.789329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:06.789969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:06.790250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:06.790523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:06.791183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:06.791488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:06.793093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:06.802617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 158/332] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:06.808955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:06.956797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab450f-9540-43e8-88ba-910424150d28 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:07.000289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:07.000967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:07.001246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:07.001520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] PATH_INFO: `/v3/users/f5153064a1c745b181124ed2586bdbb1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:07.002692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] RBAC: Authorizing `identity:get_user(user_id=f5153064a1c745b181124ed2586bdbb1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:07.004146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b749299-77f4-45aa-a7b5-37913e1603a4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:07.005974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 175/333] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:06 2022] GET /identity/v3/users/f5153064a1c745b181124ed2586bdbb1 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:07.012991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:07.028973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:07.130461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5de5bf-d493-48b8-9ccb-c8f1701a3448 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:07.164324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:07.165498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:07.165779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:07.166048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:07.166769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] RBAC: Adding query filter params (role.id=ef2ea20953d74d4098b2be1220175b2d, user.id=f5153064a1c745b181124ed2586bdbb1, scope.system=all) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:07.167071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:07.168521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1b34-9798-4939-bd4d-e48ce631c84a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:07.181212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 159/334] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Aug 25 02:43:07 2022] GET /identity/v3/role_assignments?user.id=f5153064a1c745b181124ed2586bdbb1&scope.system=all&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:07.953716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfda0f2-ceb7-4e68-b072-a0a3fe90a909 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:07.954278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfda0f2-ceb7-4e68-b072-a0a3fe90a909 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:07.954278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfda0f2-ceb7-4e68-b072-a0a3fe90a909 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:07.955977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 176/335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:07.962667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:07.963383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:07.963383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:07.989499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:07.990721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:08.065162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:08.074966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 160/336] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:08.534466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfda0f2-ceb7-4e68-b072-a0a3fe90a909 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:08.550246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:08.661722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfda0f2-ceb7-4e68-b072-a0a3fe90a909 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:08.705774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:08.706752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:08.707232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:08.707743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:08.725461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2ea7c2ad-2d71-4a5c-86c8-0c40fd6c2d77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:08.732071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:08.733058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:08.733946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:08.736325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 177/337] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:08.743876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:08.882219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fdb8be-a715-41e1-a6d1-eced981fab31 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:08.932459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e079-be03-49d6-91f8-0b2d7c992453 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:08.933235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e079-be03-49d6-91f8-0b2d7c992453 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:08.933715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef20e079-be03-49d6-91f8-0b2d7c992453 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:08.935285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 178/338] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:08.935591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:08.936530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:08.937007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:08.937474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:08.938364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:08.938863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:08.940474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:08.940831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6f5eb-95a4-47e2-8124-6c1c8cedf129 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:08.941116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6f5eb-95a4-47e2-8124-6c1c8cedf129 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:08.941397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d6f5eb-95a4-47e2-8124-6c1c8cedf129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:08.969936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 161/339] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:08.975628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:08.977032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b9d6f5eb-95a4-47e2-8124-6c1c8cedf129 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:08.978815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b9d6f5eb-95a4-47e2-8124-6c1c8cedf129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:09.079545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.092829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 179/340] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:09.094446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b66fd8-49e1-4fa5-930a-bf3cfde3e1e7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.095946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b66fd8-49e1-4fa5-930a-bf3cfde3e1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.096558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b66fd8-49e1-4fa5-930a-bf3cfde3e1e7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.098160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 180/341] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:09.099506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd743d-aa4a-4cf2-bc3b-379f2d9f8bc4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.099994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd743d-aa4a-4cf2-bc3b-379f2d9f8bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.100516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd743d-aa4a-4cf2-bc3b-379f2d9f8bc4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.102136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 181/342] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:09.108295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7519-f509-42c2-a545-9e64a10ab8cc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.108885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7519-f509-42c2-a545-9e64a10ab8cc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.109379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f7519-f509-42c2-a545-9e64a10ab8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.117820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.132166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a2f7519-f509-42c2-a545-9e64a10ab8cc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:09.133673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8e426d-e94a-429a-857a-9e234dc4f4b9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:09.134006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a2f7519-f509-42c2-a545-9e64a10ab8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:09.199762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:09.200776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.201258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.201806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.247436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 182/343] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:09.250471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.251211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.252273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.287611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:09.292242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:09.337563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:09.339382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:09.430722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 183/344] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:09.431042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.504790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 162/345] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:43:09.510778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:09.580771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.609941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:09.645907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ae8a2-bdcf-417f-a2ae-12cb1f0fea26 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:09.726863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:09.727704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.727988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.728608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.733029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:09.735300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:09.738313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 184/346] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:09 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:09.739115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:09.795002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c537741-36b2-413b-a993-7c2ac2e4df9c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:09.857755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:09.858408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.858689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.858959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.877068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:09.882236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:09.883136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:09.885033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:09.889491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 163/347] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:09.889491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:09.901264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766aa55-1a90-4ecd-8429-8739a303e7a2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:09.914502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.939861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:09.947161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:09.947891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:09.948247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:09.948628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:09.959639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:09.964592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:09.965805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:09.966836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:09.968005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 185/348] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:09.968879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.031306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f292be22-6502-412b-9e46-2e568c16eb1b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.075980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.076864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.076864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.077130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.084231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.085735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.087596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 164/349] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:09 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:10.090721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.106228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaaa81-4764-4f3e-b181-cc226a359198 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.150646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.151653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.151653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.152036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.165317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:10.170638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:10.171534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:10.172341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 186/350] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:10.173019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.195680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.221689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867d1dc-8473-4707-b862-e3deabc8c10f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.236020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.268855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.269475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.269752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.270026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.270694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:10.271504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.272949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd2b942-5d3b-4637-bfab-bc2f5db28248 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.282442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 165/351] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:10.283800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d08b0-42bf-43a1-8bfa-d8222fcddf3c None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.284090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d08b0-42bf-43a1-8bfa-d8222fcddf3c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.284363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d08b0-42bf-43a1-8bfa-d8222fcddf3c None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.285867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 166/352] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:10.286591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d08b0-42bf-43a1-8bfa-d8222fcddf3c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.308044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943e85c-b254-4b8a-bbe7-feed50c3d464 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.351409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.352999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.353286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.353849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.354531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:10.354838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.357005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.369345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 187/353] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:10.370353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.415444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d08b0-42bf-43a1-8bfa-d8222fcddf3c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.475374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.476946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.478293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.479030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.480718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:10.481426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.484321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.495573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 167/354] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:10.497444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.517981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.563023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea0f346-c585-4168-ba78-89423a9c0bdf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.579812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.609762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.610302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.610582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.610852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.611650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:10.611954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.613556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99a902-8fcb-4eb0-b8db-4312c830f49d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.624872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 188/355] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:10.626298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.626598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.626860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.647498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:10.648867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:10.653678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbd79e-0397-4485-9707-838091a57a39 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.695405 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.696080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.696362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.696664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.740286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 189/356] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:10.745306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.787437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:10.790370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaadc58-4a93-4a3b-b0d9-c68e5c6d1762 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:10.803295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.890779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b0130-a432-447b-813e-b0d29ca588dc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:10.894417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:10.921101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 168/357] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:10.927581 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de9b5-dd0b-4e73-bbb0-3928255b0c41 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.928174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de9b5-dd0b-4e73-bbb0-3928255b0c41 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.928663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023de9b5-dd0b-4e73-bbb0-3928255b0c41 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:10.930514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 169/358] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:10.931254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023de9b5-dd0b-4e73-bbb0-3928255b0c41 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:10.937637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:10.938579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:10.939084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:10.939639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.043786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.045300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7b09c-908e-4a4a-ab9b-a0368cd9aa3a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.065207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023de9b5-dd0b-4e73-bbb0-3928255b0c41 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.081980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.119983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.120918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.121074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.121356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] PATH_INFO: `/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.122667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] RBAC: Authorizing `identity:get_user(user_id=c92c4ff9f0fd4a55b53a18ae4adc6798)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.124325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.126150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 170/359] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/users/c92c4ff9f0fd4a55b53a18ae4adc6798 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.126924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.172134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 190/360] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:11.177948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.178237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.178563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.186937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.198824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:11.200020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:11.268066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e82ac-980e-4fa5-8727-de622e8da698 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.285026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 191/361] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:11.286037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.313111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.314307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.314611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.314923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.316895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.318741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.322005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 171/362] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.327753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.395793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.427815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b64151-9014-4a87-9b80-8a31e8fab8d9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.472568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0588fba-6cd6-40a9-9337-326eaf076238 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.473080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.473901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.474325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.474870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.478013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.489690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:11.497202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:11.498165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:11.498969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:11.502177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 192/363] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:11.507715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.523263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.524135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.524454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.524735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.525479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] RBAC: Adding query filter params (role.id=e419d943eb5145d191219eca713a8023, user.id=c92c4ff9f0fd4a55b53a18ae4adc6798, scope.system=all) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:11.526409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.528268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.545408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 172/364] 10.222.0.64 () {56 vars in 1308 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/role_assignments?user.id=c92c4ff9f0fd4a55b53a18ae4adc6798&scope.system=all&role.id=e419d943eb5145d191219eca713a8023 => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.546735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.636444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ba16c-862f-4357-a1ff-f416ab4ef000 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.668933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143ec4-ed3d-4c03-8928-94d254d6f41a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.671484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.676360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.677106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.677460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.678398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.679585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.681914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.684036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 193/365] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.684793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.710182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.710831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.711107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.711385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.712942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.714443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.716420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 173/366] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.717252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.769710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:11.815617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0769a3d7-fc02-4781-af8d-9e2e40cf838d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.836059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c8ad23-c364-41c3-aacd-ed482c4fef2d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:11.854613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.855278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.855562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.855834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.856607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:11.856914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.858279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.869998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 194/367] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.871165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.882224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:11.883634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:11.884097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:11.884575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:11.887835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:11.889775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:11.898279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 174/368] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:11.898279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:11.951069 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.007038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacb3d9-8e06-48b2-aa1a-b487315d6e64 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.033208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8315e189-2bf4-4c3c-b9f3-a1da9923f0c4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.034467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.050450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.051089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.051369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.052923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.070249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:12.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:12.076801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:12.077598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:12.080534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 195/369] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:12.080703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.081298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.081577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.081904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.082676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.082775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:12.082997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.084926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.093945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 175/370] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:11 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:12.094678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.224031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc891a3-d662-4e89-9233-64c8cd9e7366 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.228172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.238254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b8ee6-c148-4622-8389-f7d476639970 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.270275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.271268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.271698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.272220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.273133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:12.273443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.275425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.284331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 176/371] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:12.285514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.286198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.286300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.286477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.286748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.365752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.391792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.394082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.436224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2ed80-f221-4e6b-8736-1e1bda553779 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.485482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.486458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.486950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.487409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.488616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:12.488946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.490541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.499967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 177/372] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:12.505854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.522281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 196/373] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:12.530221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.562352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.659221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.665251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a616e8-2f5d-49a6-b185-d473497cbf37 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.680765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0982211-b5e9-4733-9e0e-357d6f6076d2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:12.704470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.705138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.705416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.705745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.726596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:12.727278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.727557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.727833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.729201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.731088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c27e0f-9528-4697-8105-6ee661e9d6c1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.733934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 197/374] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:12.735193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2259b2-f977-4aa0-8d0a-b17f34b36e0f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.735534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2259b2-f977-4aa0-8d0a-b17f34b36e0f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.735755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2259b2-f977-4aa0-8d0a-b17f34b36e0f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.737012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 198/375] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:12.744416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:12.744889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:12.745171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:12.768716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:12.770404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:12.802722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:12.805125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:12.848429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:12.863764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 199/376] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:12.864976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:12.970987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 178/377] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:43:12.977395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.023222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:13.054720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50505ee0-bf26-4926-8545-8e29d10c378b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.084649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6356cbde-5618-45e2-908f-c193ab6c4afb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.114671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:13.120736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.121391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.121673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.121949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.123530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.125694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.127329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 200/378] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:13.133961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.134627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.134910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.135185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] PATH_INFO: `/v3/projects/5c90428e27344b52a75997c9ee93262e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.136567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.137553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] RBAC: Authorizing `identity:get_project(project_id=5c90428e27344b52a75997c9ee93262e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.138991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.141051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 179/379] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:12 2022] GET /identity/v3/projects/5c90428e27344b52a75997c9ee93262e => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:13.166749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.286600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d74d77-3aa0-4e23-a51e-027100a71f28 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.321067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddcbd4-5ffb-4d7e-9084-b81e8e29407a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.325761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.326378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.326659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.326933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.327676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:13.327981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.329456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.340131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 201/380] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:13.341747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.375253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:13.403473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.403473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.403473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.403473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] PATH_INFO: `/v3/groups/0d88063c0de94d8f93986ebacba2c008` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.409371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] RBAC: Authorizing `identity:get_group(group_id=0d88063c0de94d8f93986ebacba2c008)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.410971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.413251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 180/381] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/groups/0d88063c0de94d8f93986ebacba2c008 => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:13.422683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.545643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:13.560624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71003134-59c5-42f2-8d80-adbb9ce7ed11 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.613929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038e5d5-299a-4be3-ab0a-37736b3fe57b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.620554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.621495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.622003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.622484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.633832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:13.639435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:13.640379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:13.642752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:13.645784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 202/382] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:13.652185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:13.676164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.677146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.677629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.679575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.680577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] RBAC: Adding query filter params (group.id=0d88063c0de94d8f93986ebacba2c008, role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=5c90428e27344b52a75997c9ee93262e) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:13.681136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.682834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.691268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 181/383] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/role_assignments?group.id=0d88063c0de94d8f93986ebacba2c008&scope.project.id=5c90428e27344b52a75997c9ee93262e&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:13.802967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:13.837866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90214bb6-9b19-46a5-9a90-2f400ca68da7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:13.884830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:13.885450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:13.885731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:13.886003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:13.886669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] RBAC: Adding query filter params (name=member) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:13.886971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:13.888349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:13.900301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 203/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:13.905549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:14.027627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5260dd88-a12b-4f08-9688-99d11d21f94d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:14.066394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:14.076816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:14.077467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.077746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.078020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.079145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:14.080611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:14.082351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 182/385] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:13 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:14.088874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:14.207862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d254ff-67d3-4b90-8178-7d19beb97881 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:14.245927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:14.246572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.246902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.247184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.248308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:14.249788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a392d-f82f-4ac4-81aa-89205f2f95dc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:14.251742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 204/386] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:14 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:14.261485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:14.375422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce69a7-7a51-4c4b-9c10-6862dba23737 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:14.419915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:14.420614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.420894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.421169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.423087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, group_id=69bb734c7f3b4899ba7085927e3ce98f, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:14.424555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d29e89-0a94-4558-9f64-c4bfff0d286c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:14.443777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 183/387] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Aug 25 02:43:14 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:14.556128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf614f4-5d71-4a87-9ee6-01e6936f9389 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.556674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf614f4-5d71-4a87-9ee6-01e6936f9389 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.556674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf614f4-5d71-4a87-9ee6-01e6936f9389 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.558199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 205/388] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:14.575395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809745-cbd7-4a20-8c85-21b0361cf1d2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.575705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809745-cbd7-4a20-8c85-21b0361cf1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.575945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34809745-cbd7-4a20-8c85-21b0361cf1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.595355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-34809745-cbd7-4a20-8c85-21b0361cf1d2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:14.596605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-34809745-cbd7-4a20-8c85-21b0361cf1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:14.651430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:14.673323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 184/389] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:14.985211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864ebc-8185-4cbd-a65c-c0e41846e957 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.985549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864ebc-8185-4cbd-a65c-c0e41846e957 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.985764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f864ebc-8185-4cbd-a65c-c0e41846e957 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:14.987262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 206/390] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:14.992990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:14.993504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:14.994001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.012262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:15.013843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:15.056800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f864ebc-8185-4cbd-a65c-c0e41846e957 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.061465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:15.134123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 185/391] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:15.175826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f864ebc-8185-4cbd-a65c-c0e41846e957 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.211951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.212968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.213452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.213924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.224896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:15.231062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:15.231962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:15.232826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:15.240492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 207/392] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:15.242997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.405238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2966218d-d1d3-4df8-ac29-761e72039ab2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.432759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:15.469972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.470587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.470866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.471137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.471805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:15.472108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:15.473519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:15.482002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 186/393] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:15.487120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.553763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.563195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:15.624339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d0fec-fdef-49db-84aa-59f44ec79035 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.664121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.664867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.665150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.665426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.667251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:15.669928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:15.671554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 208/394] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:15.676605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.720338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536ac065-fe52-4944-b57d-1ce6a2fd4320 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.759078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.759983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.760429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.760864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.772242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:15.777812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:15.778964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:15.779985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:15.782161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 187/395] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:15.788143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.831221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:15.877126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595080a-ec42-49f6-bf85-ee2f24778f78 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.911921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:15.913671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b7c9e-56e4-4016-9f39-5481c8770cf0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:15.919618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.920352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.920769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.921110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.922319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:15.924345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c6c3e8-96af-4b6f-94db-23ef0bcc52c6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:15.926892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 209/396] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:15.928619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370009ea-991d-4434-9d7f-047edd779730 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.928970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370009ea-991d-4434-9d7f-047edd779730 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.929321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370009ea-991d-4434-9d7f-047edd779730 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.932466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 210/397] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:15.933463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370009ea-991d-4434-9d7f-047edd779730 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:15.958787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:15.959779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.960243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.960732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:15.961729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:15.962214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:15.964170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fd6bb-c5de-4656-8fb8-1870d8ccd406 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:15.973629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 188/398] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:15.978555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:15.978555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:15.978555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.000928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:16.002404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:16.058142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370009ea-991d-4434-9d7f-047edd779730 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.095634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.096678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.097250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.097728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.100160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] RBAC: Authorizing `identity:create_grant(project_id=b736d11e57cd474c84f4b2bb18a65a24, group_id=69bb734c7f3b4899ba7085927e3ce98f, role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:16.101888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:16.104510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 189/399] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:16.105760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.127066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 211/400] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Aug 25 02:43:15 2022] PUT /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:16.138395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:16.220102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e659b0-832e-4784-87f3-6bb0dce18eaf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.260331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.261030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.261312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.261585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.262806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:16.264295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19950397-ccef-4677-91e1-fe8c83f4fc39 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:16.266359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 190/401] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:16 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:16.277875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.364586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:16.422440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf752198-3e0b-488a-adf0-4332cedba407 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.437828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec58cdb-6687-4114-9c3e-d38837c32daf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.438323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec58cdb-6687-4114-9c3e-d38837c32daf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.438648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec58cdb-6687-4114-9c3e-d38837c32daf None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.439999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 191/402] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:16.445304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.445581 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.445887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.469830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.470471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.470753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.470962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:16.471067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.472150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:16.472817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:16.473623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:16.475387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 212/403] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:16 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:16.476172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.561297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 192/404] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:16.562301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.597337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:16.614048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2eee7-fe79-4749-be97-4dcee9607d93 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.661489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:16.679450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.680485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.681432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.682906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.705776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:16.722556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:16.723504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:16.724278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 213/405] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:16.732351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.740611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3b38c-009d-4d2b-8773-a2d7c92a633e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.783629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.784703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.785182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.785667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.788323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, group_id=69bb734c7f3b4899ba7085927e3ce98f, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:16.791177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceef05e-532b-4147-a6b4-4a5d8f09a665 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:16.810895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 193/406] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Aug 25 02:43:16 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:16.822572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5297-165e-4213-9188-964da90d837f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.822904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5297-165e-4213-9188-964da90d837f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.823134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5297-165e-4213-9188-964da90d837f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.828805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 194/407] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:16.830757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.831041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.831882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.855092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:16.856863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:16.916954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56934d9-52a4-46d5-bcf3-2993f8735376 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:16.956429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 195/408] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:16.956429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:16.971413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:16.972347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:16.972844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:16.973322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:16.973812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:16.975063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:16.975568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:16.977346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.000544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 214/409] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:17.008148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.067007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.087916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce525e-b399-43cb-b1ba-d981960b2d10 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.129630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.130819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.131317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.131799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.158211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5b96-7063-4ddd-95c7-856e7b0ac700 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.165035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:17.170327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:17.171209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:17.171999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:17.178725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 196/410] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:17.184887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.203961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.205007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.205511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.206002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.209680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.214292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.216220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 215/411] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:17.221848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.343341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.374788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cf255-eaa2-463c-b759-fa3ad3d85283 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.399891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b85fc1-37c2-4b0c-a11e-abecfd862b08 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.421029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.422043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.422519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.423001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.423966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:17.424518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.424996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.427375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.438713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 197/412] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:17.440278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.451365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.452578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.452867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.453148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.454318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.456246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.463469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 216/413] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:17.463469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.574590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f55b5-4549-420c-a150-68cad7a42950 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.580911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e7d42-80b2-4371-978f-1de3f7d878ef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.615666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.616751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.617493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.618668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.623924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.624645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.624939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.625352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] PATH_INFO: `/v3/groups/0d88063c0de94d8f93986ebacba2c008` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.626766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] RBAC: Authorizing `identity:get_group(group_id=0d88063c0de94d8f93986ebacba2c008)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.627943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.629916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.637167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 217/414] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/groups/0d88063c0de94d8f93986ebacba2c008 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:17.637601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:17.638155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:17.643110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:17.643978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:17.645809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:17.648287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 198/415] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:17.653300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.708975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.766680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10d134-2621-41aa-b55d-bcb6a20b6878 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.774532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c9a5b-7cd2-4191-972b-d583c2b54a8b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.809372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.810489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.810981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.811533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] PATH_INFO: `/v3/projects/5c90428e27344b52a75997c9ee93262e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.811646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:17.812355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:17.812692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:17.813039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:17.813554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] RBAC: Authorizing `identity:get_project(project_id=5c90428e27344b52a75997c9ee93262e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.815297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.815538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] RBAC: Authorizing `identity:create_grant(project_id=be40c16bbd05492c8a9c2fab5ca0b764, group_id=69bb734c7f3b4899ba7085927e3ce98f, role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:17.817082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:17.817569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 199/416] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/projects/5c90428e27344b52a75997c9ee93262e => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:17.818565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.837541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 218/417] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Aug 25 02:43:17 2022] PUT /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764/groups/69bb734c7f3b4899ba7085927e3ce98f/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:17.838670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:17.944032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:17.975322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f574a-b133-48d4-8a39-3b4cac899238 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:17.994188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:18.028200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:18.029261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.029732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.030219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] PATH_INFO: `/v3/projects/5c90428e27344b52a75997c9ee93262e/groups/0d88063c0de94d8f93986ebacba2c008/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.032731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] RBAC: Authorizing `identity:create_grant(project_id=5c90428e27344b52a75997c9ee93262e, group_id=0d88063c0de94d8f93986ebacba2c008, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:18.034932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:18.038490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f69a33-6e70-47a9-8a12-44939b7e9c6f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:18.054572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 219/418] 10.222.0.64 () {58 vars in 1442 bytes} [Thu Aug 25 02:43:17 2022] PUT /identity/v3/projects/5c90428e27344b52a75997c9ee93262e/groups/0d88063c0de94d8f93986ebacba2c008/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:18.092788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:18.093422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.093701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.093976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.094655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:18.094968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:18.096354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28efbd-e8e2-4f16-b913-86aa865595cb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:18.107640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 200/419] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:18.113538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:18.236036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1247a972-6f3a-4373-ae38-9b25dd2e544b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:18.271721 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:18.272338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.272650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.272930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.320554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:18.351762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:18.353316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:18.361241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244882be-1365-4430-914f-8c800a9c2754 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.361842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244882be-1365-4430-914f-8c800a9c2754 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.362318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244882be-1365-4430-914f-8c800a9c2754 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.365995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 201/420] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:18.373633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896750b-8135-41aa-bd9a-976921789799 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.374214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896750b-8135-41aa-bd9a-976921789799 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.374691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896750b-8135-41aa-bd9a-976921789799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.407070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8896750b-8135-41aa-bd9a-976921789799 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:18.408450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8896750b-8135-41aa-bd9a-976921789799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:18.495173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 202/421] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:18.495778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 220/422] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:18.501575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896750b-8135-41aa-bd9a-976921789799 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:18.588613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:18.644456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896750b-8135-41aa-bd9a-976921789799 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:18.696044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:18.696725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.697012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.697271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.699064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:18.700565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:18.704474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 203/423] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:18 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:18.709479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:18.822318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:18.831541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:18.854034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736164-8d1d-4793-b891-c1b33d29c5fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:18.929109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:18.929760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:18.930565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:18.930842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:18.931984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:18.933463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:18.935203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 221/424] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:18 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:18.940758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:18.991229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ceac4-e926-4f0a-899a-b4aae59f8330 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.048182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.066140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.068355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.068853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.070024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.099927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:19.105185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:19.106077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:19.106879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:19.111100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 204/425] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:19.118436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.125012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6581bbf-7e1a-4cd3-adcb-76478930aabb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.162824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.164135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.165126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.165786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.166842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:19.167644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.169537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5c003-1a3e-43bd-8b8c-657a246d1d4a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.177406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 222/426] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:18 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 611 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:19.178818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f2dd-3b8f-407b-9abd-28607a2c8017 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.179631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f2dd-3b8f-407b-9abd-28607a2c8017 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.180709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860f2dd-3b8f-407b-9abd-28607a2c8017 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.183007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 223/427] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:19.189849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.190035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.190291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.208906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:19.210156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:19.218639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.249315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c0c57-2680-40c8-9364-047d61f7f566 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.287216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.288217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.288714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.289244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.290681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:19.291317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.293186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.294664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 224/428] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:19.303771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 205/429] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:19.312498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.429483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e3823-57be-4126-9ba8-fc9a067310e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.466867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.467494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.467777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.468056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.472712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.540321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.541834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.640433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.643212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 225/430] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:19.648589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.697625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.734594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.759092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8e744-4d24-419b-9f54-358a4fe250ed None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.760008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f2c436-0128-435d-9b97-535ba4d71f10 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.797175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.798089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.798511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.798975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.799204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.799938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.800340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.800744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] PATH_INFO: `/v3/projects/b736d11e57cd474c84f4b2bb18a65a24` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.802090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] RBAC: Authorizing `identity:get_project(project_id=b736d11e57cd474c84f4b2bb18a65a24)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.803741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.805882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 226/431] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/projects/b736d11e57cd474c84f4b2bb18a65a24 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:19.811029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.811621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:19.817162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:19.818267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:43:19.819249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:19.821862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 206/432] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:19.827904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.926719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9ac2d-cb94-466d-8666-87bb251523f3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.936748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.937642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89956ea8-b98d-4bfc-8b52-64655cd0f63c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:19.948846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:19.970441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.971510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.971992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.972499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.974737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.975731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:19.976344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:19.976653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:19.976965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:19.977347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.977632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] RBAC: Adding query filter params (name=member) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:19.977934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:19.979313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:19.980239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 227/433] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:19.990275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:19.990450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 207/434] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:19.995999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.101708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3a147-f3d1-451b-85e7-34431010e101 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.134877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcfd86-5a51-4271-bc71-486ff48aefa3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.146625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.147244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.147525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.147799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.175006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.175617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.175898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.176227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.177373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=b736d11e57cd474c84f4b2bb18a65a24) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:20.177629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:20.180114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e247bbf-5cd9-4305-a1ba-1500459f4acd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:20.189186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 228/435] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=b736d11e57cd474c84f4b2bb18a65a24&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 611 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:20.204527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:20.245327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:20.246846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:20.259424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0ca2-6091-4d8d-938d-f97aded63a4b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.260556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0ca2-6091-4d8d-938d-f97aded63a4b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.261093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd0ca2-6091-4d8d-938d-f97aded63a4b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.263080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 229/436] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:20.270076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3202-02aa-475f-9993-d525646165f3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.270672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3202-02aa-475f-9993-d525646165f3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.271150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8d3202-02aa-475f-9993-d525646165f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.309103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8c8d3202-02aa-475f-9993-d525646165f3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:20.311181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c8d3202-02aa-475f-9993-d525646165f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:20.356015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:20.389176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 208/437] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:20.395300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.414911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 230/438] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:20.458346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d5d1-c5bc-4095-a38f-0ef1defe08ec None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.458647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d5d1-c5bc-4095-a38f-0ef1defe08ec None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.458946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f672d5d1-c5bc-4095-a38f-0ef1defe08ec None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.460423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 231/439] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:20.467842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.468123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.468473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.491462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:20.491642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:20.493476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:20.533473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2457-2f23-4b46-9db3-9c414d25d0ca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.572634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.573271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.573652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.573815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.574920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:20.576349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:20.578205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 209/440] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:20.583498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.584465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 232/441] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:20.691768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.695957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e244fc-afc3-4acd-a16d-9d1a4485af9b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.735567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.736566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.737045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.737539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.740967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:20.743531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:20.745407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 210/442] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:20.753447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.764485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:20.811787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:20.820428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63727b8a-fee3-40cc-915d-b0688181dd54 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.857741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.858371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.858645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.858913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.865110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8793dc6e-67b3-4d61-914a-c7acb44be060 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:20.869523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:20.874154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:20.875013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:20.875794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 233/443] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:20.876485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.904546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:20.905151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:20.905427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:20.905719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:20.906430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=ef2ea20953d74d4098b2be1220175b2d, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:20.906733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:20.908158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:20.913734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 211/444] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=ef2ea20953d74d4098b2be1220175b2d => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:20.915001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:20.984704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a0a1d-8c3a-4e2b-aceb-4dc02c78c784 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.006393 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.027073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.027730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.028037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.028289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.040809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:21.042351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a39cc9-dfa4-4d15-817c-42382d3c533e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:21.046118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:21.047046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:21.049269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 234/445] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:21.053140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.074165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.089755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.090701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.091056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.091403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.092357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:21.092768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.094294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.103355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 212/446] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:21.109181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.171546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e2e62d-becd-4a22-b2c6-d11378fbdc9d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.208529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.209133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.209411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.209686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.210348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:21.210651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.214126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.221371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 235/447] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.226827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.236334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30c38b9-158e-4303-9209-a9a88bc573cc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.272512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.278956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.279563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.279839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.280497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.316352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.339446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b531bdc-2d14-4447-a6b0-e266b6563fe1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.346563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.348005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.372370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.372995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.373277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.373553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.440375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.441837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.447415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 213/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:43:21.453523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.482851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.519484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.542568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 236/449] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:43:21.548191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.553601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08463a80-eff0-418e-8e19-73203df9c352 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.587774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.588417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.588700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.588968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] PATH_INFO: `/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.590083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] RBAC: Authorizing `identity:get_project(project_id=be40c16bbd05492c8a9c2fab5ca0b764)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.591514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.593166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 214/450] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/projects/be40c16bbd05492c8a9c2fab5ca0b764 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.598606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.643937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a51ee-96cd-4601-9cd8-bb314c10b08b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.677854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.678469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.678746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.679017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] PATH_INFO: `/v3/projects/5c90428e27344b52a75997c9ee93262e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.680136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] RBAC: Authorizing `identity:get_project(project_id=5c90428e27344b52a75997c9ee93262e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.681615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.683244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 237/451] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/projects/5c90428e27344b52a75997c9ee93262e => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.688689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.696041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.698993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf6dcc-e5cb-4f70-92d0-e9f5046760e9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.733742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.734365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.734638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.734903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] PATH_INFO: `/v3/groups/69bb734c7f3b4899ba7085927e3ce98f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.735941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.736055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] RBAC: Authorizing `identity:get_group(group_id=69bb734c7f3b4899ba7085927e3ce98f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.737434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.739153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 215/452] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/groups/69bb734c7f3b4899ba7085927e3ce98f => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.745612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.794307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e1be6-efe6-45fb-b6f6-716b70a02328 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.827780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.828458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.828691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.828965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] PATH_INFO: `/v3/groups/0d88063c0de94d8f93986ebacba2c008` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.830085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] RBAC: Authorizing `identity:get_group(group_id=0d88063c0de94d8f93986ebacba2c008)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.831517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.833133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 238/453] 10.222.0.64 () {56 vars in 1180 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/groups/0d88063c0de94d8f93986ebacba2c008 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.839017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:21.844145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587d7d7-854f-4114-a2a9-a884764910d9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.880969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.881573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.881850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.882180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.882922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] RBAC: Adding query filter params (group.id=69bb734c7f3b4899ba7085927e3ce98f, role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:21.883861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.885344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352b344-bd0e-40bc-9623-e880d5c689bb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.891178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 216/454] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/role_assignments?group.id=69bb734c7f3b4899ba7085927e3ce98f&scope.project.id=be40c16bbd05492c8a9c2fab5ca0b764&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:21.940058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1ea-0aa1-489d-80a0-64dbbd040558 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:21.957577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:21.978675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:21.979291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:21.979567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:21.979835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:21.980612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] RBAC: Adding query filter params (group.id=0d88063c0de94d8f93986ebacba2c008, role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=5c90428e27344b52a75997c9ee93262e) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:21.980921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:21.982361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda4c4f-a597-4235-8865-fa976f14a7c7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:21.988748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 239/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu Aug 25 02:43:21 2022] GET /identity/v3/role_assignments?group.id=0d88063c0de94d8f93986ebacba2c008&scope.project.id=5c90428e27344b52a75997c9ee93262e&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:24.365378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03122-1e03-447c-b540-d8ba9c618028 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.366380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03122-1e03-447c-b540-d8ba9c618028 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.367134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d03122-1e03-447c-b540-d8ba9c618028 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.368796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 217/456] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:24.374379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f778c-3bb0-4d08-b04f-a24c9f9b221e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.375194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f778c-3bb0-4d08-b04f-a24c9f9b221e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.375672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f778c-3bb0-4d08-b04f-a24c9f9b221e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.410121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9f4f778c-3bb0-4d08-b04f-a24c9f9b221e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:24.411674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9f4f778c-3bb0-4d08-b04f-a24c9f9b221e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:24.503024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 240/457] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:24.619574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d31e-59d4-42da-8980-fb3b87ea8e3d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.620172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d31e-59d4-42da-8980-fb3b87ea8e3d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.620689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6d31e-59d4-42da-8980-fb3b87ea8e3d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.622261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 218/458] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:24.629141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.629651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.630131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.652939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:24.654496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:24.744255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea43-827b-4b13-9b93-0744c3678173 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.744902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea43-827b-4b13-9b93-0744c3678173 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.745376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddea43-827b-4b13-9b93-0744c3678173 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.750909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 219/459] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:24.752954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:24.753441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:24.753913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:24.756089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 241/460] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:24.785830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:24.787407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:24.826559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:24.827862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:24.892837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:24.932538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 220/461] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 25 02:43:24.980816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c6d04-add7-4eac-9234-7d8314fdaa02 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.027429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.028043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.028318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.028621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.038930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.040996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.049349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:25.065270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:25.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:25.067478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:25.067478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.067478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:25.067478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 242/462] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:25.074761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.172587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:25.182028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca37e8-dd58-4933-9df4-085bf1e405f2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.224524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.225126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.225398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.225664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.226357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:25.226690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.228044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.241706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a6a72-6d77-437c-9696-ff3da005c949 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.254627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 243/463] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:25.265349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.288895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.290144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.290760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.291231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.304338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.305848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-907d1de6-f960-4861-a6dc-87bcda9fef1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:25.325869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:25.326767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:25.327600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:25.327600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.327600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:25.327600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 221/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:25.328327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e9b7-401a-4046-8689-222d4da96af0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.328461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e9b7-401a-4046-8689-222d4da96af0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.328702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e9b7-401a-4046-8689-222d4da96af0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.330100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 222/465] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:25.330641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e9b7-401a-4046-8689-222d4da96af0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.349185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:25.389787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196a38fb-e5f7-42b7-be04-85cf45fabc59 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.427538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.427932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.428212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.428513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.429146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.430601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.452763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e9b7-401a-4046-8689-222d4da96af0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.453270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 244/466] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:25 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:25.453846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.465214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:25.516810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.517820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.518101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.518375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.533964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.535831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5b4f1c23-4592-4251-b0ad-dd5a289e371d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:25.557098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:25.558522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:25.559397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:25.559397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:25.559397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:25.559397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 223/467] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:25.559618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.560026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.560120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.579792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:25.581090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:25.590749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1727bd0-fc7f-442a-bda2-cddf626d6564 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.644378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.645022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.645304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.645579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.646232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:25.646538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.647955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.665221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 245/468] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:25.666625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.668845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:25.685348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 224/469] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:25.686124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.765027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:25.814124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d21dd0-dab6-4b66-8088-677d030c32b1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.818361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579aa251-5fb7-4ec8-852f-1d5daf0879bc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:25.854377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.854994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.855274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.855545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.856188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:25.856518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.858421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.873286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 246/470] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:25.885177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:25.894968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:25.895585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:25.895860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:25.896127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:25.896793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:25.898220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f9e55-8ce3-457a-9bf2-a037e9a6f464 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:25.933570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 225/471] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:25 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:26.014583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33b384-e872-4119-bdb0-e52e6acbb660 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.014917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33b384-e872-4119-bdb0-e52e6acbb660 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.015104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33b384-e872-4119-bdb0-e52e6acbb660 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.016955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 226/472] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:26.027719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.028212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.028732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.037035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cad78-3f11-4283-baff-f34cf1385df4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.054708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:26.056831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:26.068698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:26.080688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.081148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.081429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.081700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.082354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:26.083847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:26.113268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 247/473] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:25 2022] POST /identity/v3/users => generated 248 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:26.114267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:26.125225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:26.153483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 227/474] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:26.239096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fc971-ba0e-4750-b3d6-228c30041bd3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.277490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.278360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.278836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.279251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.290358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:26.292054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:26.307467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:26.308539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:26.309423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:26.309423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:26.309423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.309423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 248/475] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:26.316022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:26.442737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dbefa1-278e-4af9-a46a-0921cbb1581f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.451397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:26.481514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.482714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.483148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.483419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.484077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:26.484516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:26.485913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:26.490922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:26.500616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 228/476] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:26.507161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:26.592655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:26.601403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c6036-3a1e-4618-bcef-99fb96aedf5b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.665788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.666413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.666697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.666976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.667876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:26.669092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:26.681324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff8393-103d-4308-af3f-394b14599e49 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.683573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:43:26.683573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 02:43:26.683573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [parameters: {'id': 'f489b337a9ce43648e5291375d00ea66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 02:43:26.683573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:43:26.707800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return ref.to_dict() Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:43:26.708768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:43:26.709659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:43:26.710522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:43:26.711416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:43:26.712220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': 'f489b337a9ce43648e5291375d00ea66', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:26.713473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 02:43:26.714414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.715597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 249/477] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Aug 25 02:43:26 2022] POST /identity/v3/roles => generated 144 bytes in 258 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:26.716285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:26.728063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.729044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.729461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.729929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.730823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:26.732677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:26.767623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 229/478] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:26 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:43:26.872191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:26.877125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac46e86-667b-44c7-b8be-8ed3e4f099a3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:26.916933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:26.918160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:26.918515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:26.918859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:26.936841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d7e4266e-0cb8-4ba7-8e26-1e0f725a940f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:26.941968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:26.943119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:43:26.944083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:26.948551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 250/479] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:26.951179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:27.084276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:27.089262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2befb5-a530-47e9-960c-1269a09878ae None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:27.126793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:27.127330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:27.127609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:27.127880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:27.128565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:27.128866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:27.130233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b65cb2e-4a68-4514-8f02-167cdcda205e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:27.138980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 230/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:27.789371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2348-2f71-4ae7-9905-e33f8386ef73 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:27.789880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2348-2f71-4ae7-9905-e33f8386ef73 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:27.789953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2348-2f71-4ae7-9905-e33f8386ef73 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:27.791514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 251/481] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:27.796830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ceb0-0268-4cf5-94d3-ca1ffb518b08 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:27.797243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ceb0-0268-4cf5-94d3-ca1ffb518b08 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:27.797431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24ceb0-0268-4cf5-94d3-ca1ffb518b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:27.819793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fd24ceb0-0268-4cf5-94d3-ca1ffb518b08 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:27.821591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fd24ceb0-0268-4cf5-94d3-ca1ffb518b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:27.913278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 231/482] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:28.306639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2348-2f71-4ae7-9905-e33f8386ef73 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:28.364935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5710-8bae-4a2b-a301-52fe3782fa34 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.365256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5710-8bae-4a2b-a301-52fe3782fa34 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.365522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d5710-8bae-4a2b-a301-52fe3782fa34 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.372418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 232/483] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:28.374042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ebb7-9e31-4fb6-9192-0a5e2bd7c784 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.374390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ebb7-9e31-4fb6-9192-0a5e2bd7c784 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.374671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9ebb7-9e31-4fb6-9192-0a5e2bd7c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.415722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-05c9ebb7-9e31-4fb6-9192-0a5e2bd7c784 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:28.418948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-05c9ebb7-9e31-4fb6-9192-0a5e2bd7c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:28.449799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2348-2f71-4ae7-9905-e33f8386ef73 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:28.528574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:28.529217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.529501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.529777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.553517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a54278de-c0d2-416d-82f7-e5c36dfffd18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:28.559250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:28.560137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:28.561522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 252/484] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:28.562199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212ac5-2e44-47b6-be9a-85ad58a0e396 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.562199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212ac5-2e44-47b6-be9a-85ad58a0e396 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.562199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08212ac5-2e44-47b6-be9a-85ad58a0e396 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.563309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 253/485] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:28.576368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08212ac5-2e44-47b6-be9a-85ad58a0e396 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:28.576691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 233/486] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:28.576691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.576691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.576691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.606848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:28.608306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:28.617582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:28.640043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:28.745042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 234/487] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:28.774096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08212ac5-2e44-47b6-be9a-85ad58a0e396 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:28.816442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:28.817036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:28.817293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:28.817516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:28.818190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:28.818491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:28.822253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:28.834259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 254/488] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:28.840445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:28.852040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:28.985530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b574f3-9be5-4d87-8e20-7c6e89a55d87 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.023967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.024758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.025037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.025310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.044820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.049422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.051157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.073460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fa521a-f32b-40a6-af1f-294f266e06e9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:29.089931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:29.092130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:29.094240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:29.094240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:29.094240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:29.094240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 235/489] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:29.101400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.109360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.109989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.110270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.110544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.113001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.123849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:29.130920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:29.131838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 255/490] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:29.136904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.239360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deede4e-49a9-4302-8073-fe083f40a05d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.266946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a3c83a-e23e-49d3-8fec-3652814be75b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.276691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.277632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.278124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.278600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.279431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:29.279928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.281529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.299592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 236/491] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:29.300819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.312726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.313392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.313677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.313955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.328853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.329542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:29.336886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:29.338189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:29.338967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:29.343641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 256/492] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:29.345282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.385725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.438352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cff9-1296-4bed-a366-ebb48b76b6d6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.467043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4aed5-72c5-43ce-bd21-ddc15e0ed3f9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.478290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.478903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.479188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.479456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.480113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:29.480438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.481805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.489677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 237/493] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:29.490554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.515769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.517079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.517766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.518364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.530041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.532555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-00e63f67-3717-43e9-a98f-6275ffd0d8bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:29.547791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:29.549669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:29.551400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 257/494] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:29.554008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5083b-b6ab-4ce2-ae69-6369c2555d89 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.554008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5083b-b6ab-4ce2-ae69-6369c2555d89 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.554008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5083b-b6ab-4ce2-ae69-6369c2555d89 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.560478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 258/495] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:29.560478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5083b-b6ab-4ce2-ae69-6369c2555d89 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.623288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeca2d2-6a79-4049-a10f-654acfbd9534 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.628273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.649083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.660279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.660910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.661191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.661462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.662148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:29.662448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.663828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.672064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 238/496] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:29.672888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.681228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5083b-b6ab-4ce2-ae69-6369c2555d89 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.715428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.716057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.716337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.716711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.727571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.729225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6ec74a8f-0d9f-4ba0-9812-0f5cb02a3668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:29.744071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:29.745165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:29.745999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:29.745999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:29.745999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:29.745999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 259/497] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:29.746497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b99ee-7ad9-4a54-8f13-b74a13278833 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.746735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b99ee-7ad9-4a54-8f13-b74a13278833 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.747013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58b99ee-7ad9-4a54-8f13-b74a13278833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.764273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a58b99ee-7ad9-4a54-8f13-b74a13278833 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:29.765520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a58b99ee-7ad9-4a54-8f13-b74a13278833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:29.772136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf048-57c1-4358-b662-a4ce5b535e50 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.805592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.806553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.806553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.806754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.807442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:29.807747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:29.809193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:29.830978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 260/498] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:29.832228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b9e7-85b5-49fa-8ee6-f6cb44599c2e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.832542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b9e7-85b5-49fa-8ee6-f6cb44599c2e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.832814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e60b9e7-85b5-49fa-8ee6-f6cb44599c2e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:29.834046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 261/499] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:29.837284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b9e7-85b5-49fa-8ee6-f6cb44599c2e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.845427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 239/500] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:29.846271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:29.890105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.896934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:29.952404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e60b9e7-85b5-49fa-8ee6-f6cb44599c2e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.964032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce01e9-c70e-4a02-8aae-9b5c96d6589b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:29.990860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:29.991490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:29.992019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:29.992334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.001428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.002253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.002676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.003021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.003267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.004041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:30.004520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.004729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.007322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c516cc54-8bcf-4e25-80f1-dd0f4a162f36 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.018847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 240/501] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:30.019145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.019966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:30.020840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:30.020840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.020840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:30.022144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.022568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.022962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.025426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 262/502] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.026482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.042986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:30.044491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:30.117175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 241/503] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:30.118051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.124996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.132441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe5e92-4f67-4456-a8a5-13791138e4c0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.157565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.169423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.170039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.170318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.170591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.225087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212516d-6151-4158-88a9-c71a6bd36b87 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.243133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.244977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.262822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.263644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.264075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.264346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.271498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.272987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:30.286401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.287514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 242/504] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.288643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.350868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.360425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 263/505] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:30.360687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.401669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.412417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532f9eb-2ec5-4326-be6f-148ac5ba84c5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.447491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.448092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.448372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.448702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.449316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:30.449623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.451007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.462991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 243/506] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:30.463791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.472264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0bc3-a47f-40ef-9690-856a21411c61 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.507390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.508574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.508855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.509343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.519005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:30.524188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.525118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:30.525930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 264/507] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.527026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.563096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd1a75-c06e-4a11-86f5-b1f38a393b3c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.582284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.597097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.597705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.597986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.598261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.598983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:30.599287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.600752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.619244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 244/508] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:30.620149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.631407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6f70b-4d27-4d10-b0fb-8460399db7db None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.633882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.665565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.666123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.666401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.666675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.676542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.678037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:30.693739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.694665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:30.695546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:30.695546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.695546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:30.695546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 265/509] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.695763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.719922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528609b-efa2-44d9-9ec3-6bd1e758bbbb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.754503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.755132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.755449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.755727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.765563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.766995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:30.781525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.782632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:30.783672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:30.783672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:30.783672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:30.783672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 245/510] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.783672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.799464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df649f9-3371-4b67-bc2b-7cbf719d1516 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.806443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.833945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.834657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.834942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.835216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.842611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.844179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.846369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:30.856515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:30.857441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 266/511] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:30.858387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.886293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c792f2-0d02-408a-94d1-b018f2cffce5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.919750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.920345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.920652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.920923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:30.921606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:30.921908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:30.923294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:30.931100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 246/512] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:30.931975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:30.962144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed36f5-f00d-4404-a1f6-3645b778d299 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:30.996831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:30.997438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:30.997718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:30.998000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.031059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.040612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8c12e-4af6-46ce-ac0d-666209017f7c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.065089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.065232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.067044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.074219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.074856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.075174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.075453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.076086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:31.076407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.077770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.089738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 247/513] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:31.090614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.163028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 267/514] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:31.163877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.189478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3796a55-6016-4f44-9d3a-7b34b91c71e6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.222763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.223369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.223653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.223928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.224593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:31.224895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.226263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.227563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.238012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 248/515] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:31.238827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.265943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e437e1-3ec4-4ac1-860a-282b3952cb46 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.287107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.298979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.299592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.299873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.300149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.300903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:31.301209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.302647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.338887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 268/516] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:31.339797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.341664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629ec30-cf0f-4f8e-a7fe-f0aca25e515f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.375650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.376283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.376591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.376866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.391360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.392835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:31.407291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:31.408268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:31.409148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:31.409148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:31.409148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:31.409148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 249/517] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:31.409372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.440519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4d7c-a681-4d8d-89de-952b126104aa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.463904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.475132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.475758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.476035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.476313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.482987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.484446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:31.498381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:31.499243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:31.500072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 269/518] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:31.500603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.512025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.516250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5b729-e251-42dc-b5e3-29ad843ecaa5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.548890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.549594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.549941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.550281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.561167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.562673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:31.576873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:31.577950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:31.583632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:31.583632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:31.583632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:31.583632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 250/519] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:31.583632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.598832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd164b-126e-4d18-93e3-aa7a0000ba18 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.631342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.631938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.632211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.632515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.633718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.635146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.655158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 270/520] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:31 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:31.655970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.683667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87876e7-eaf3-4741-9daa-526e596308b9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.706258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.725015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.726092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.726565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.726844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.749573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.781364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15737bb-0770-4585-ac44-00d774fd5f10 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.806732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.808215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.823152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:31.823775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:31.824058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:31.824917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:31.825096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:31.825348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:31.826716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:31.841459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 271/521] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:31.843515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.922221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 251/522] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:31.923104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:31.964419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:31.967334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efe83-237c-44b6-a3f9-5d9177b7c1e9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:31.980505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.010278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.011161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.011586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.012012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.012754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.013057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.014654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.035954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100d528-bb5b-495e-9382-f07f3a126768 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.039646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 272/523] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.040157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.073601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.074273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.074555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.074831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.075517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.075818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.077289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.088954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 252/524] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.089766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.154139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58344a0e-86d1-4378-aeea-f9bf5648aa1b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.193592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.194225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.194520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.194774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.196773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f5cc-f0e2-45e2-b684-abb436d42072 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.202597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.204165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.207813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:32.217077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:32.218166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:32.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:32.222887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 273/525] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:32.223713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.238191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.238846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.239134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.239390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.248756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.252102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.253602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:32.268179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:32.269231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:32.270078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:32.270078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:32.270078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:32.270078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 253/526] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:32.270078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.340488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c385f5-828d-41d8-a6cf-bc80e0930cca None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.374136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.374737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.375017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.375286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.376007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.376311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.377785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.392769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 274/527] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.392769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.393057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d598560-4256-4daa-a424-8aac3821a79b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.425177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.426002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.426350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.426690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.434639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.436222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:32.449777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:32.450769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:32.451612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 254/528] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:32.452689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.482000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.504795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.516518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad4603-5cb7-4dbd-8962-f48ea97cec93 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.567009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.567650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.568000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.568282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.569102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.569413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.571608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.575134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad0916-2efe-4572-a521-b105e0dc704e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.595988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 275/529] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.596901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.615907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.616721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.617300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.617577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.618515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.618817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.620195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.642211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 255/530] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.643160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.712166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2aae-380f-4b0e-a519-ec8b7ed7ba7b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.750707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.754535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.755247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.755529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.755801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.756820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:32.757127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.759096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.772485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27391881-9a7d-4c89-992c-341f600e0331 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.774574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 276/531] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:32.775993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:32.783295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:32.825870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.827054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.827798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.828268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.905233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0be43-fe3c-4729-8e72-b82cdb0fdcad None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:32.909071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.910534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.950022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:32.951007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:32.951477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:32.951965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:32.962286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:32.964832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:32.980720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:32.981628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:32.982439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 277/532] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:32.983396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.006411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:33.030375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 256/533] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:33.031474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.056814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:33.090801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d77b1b-a0cc-41e1-a50b-e263609e787c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.128004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.128820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.129291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.129839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.131433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=23232654097d435a9ebe540ada43804d) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:33.131924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.134415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.148609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 278/534] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:32 2022] GET /identity/v3/role_assignments?user.id=23232654097d435a9ebe540ada43804d&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:33.148609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.157893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a4678e-9270-4fb4-bed9-6996420abe3a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.235125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.235744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.236017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.236284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.237088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:33.237386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.238857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.277940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 257/535] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:33.285426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.351283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93ea054-df51-4265-b5ec-7f32084c5863 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.357673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:33.416410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:33.434294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b75f9-fd24-4100-bc07-b2038fbd36d3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.438798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.439686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.440186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.440696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.466926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.468902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.470882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=bf080f10671b4fd8aaf6e232d5f8b2f3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.476416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.480749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 258/536] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/role_assignments?user.id=bf080f10671b4fd8aaf6e232d5f8b2f3&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:33.493714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:33.494668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:33.495507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:33.495507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:33.495507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:33.495507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 279/537] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:33.500880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.617940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37389716-68cb-4d24-8cb6-d0acb3dbfa84 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.625956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:33.656575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.657488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.657916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.658347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.659327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:33.659824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.661284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e880c6c-92d7-4cd9-9a18-79528e037401 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.675180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 259/538] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:33.681463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.720150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ed6b-6a00-4fac-83c4-0cf99d03b3e4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.720618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ed6b-6a00-4fac-83c4-0cf99d03b3e4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.720989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80ed6b-6a00-4fac-83c4-0cf99d03b3e4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.722460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 260/539] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:33.729289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.729709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.730148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.753420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:33.754802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:33.804250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ac44d-3c83-44af-bf60-06debffa9caa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:33.844933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:33.845798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:33.846240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:33.846665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:33.854812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:33.856961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:33.870948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:33.872015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:33.873085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:33.875700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 280/540] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:33.884444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 261/541] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:33.889393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:33.949804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:34.031801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58499e4a-e9c1-41af-b722-02ba1c00fefa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:34.067510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:34.068125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.068421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.068711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.069401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:34.069707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:34.071724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:34.084540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 281/542] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:34.090073 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:34.207996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:34.217193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544fd05d-6e99-436b-822e-3ee2563d2d72 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:34.266915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:34.267529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.267812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.268088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.268840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=868cf3d873a349d1bc43e309a9a6acc2) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:34.269148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:34.270572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:34.276561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 262/543] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:34 2022] GET /identity/v3/role_assignments?user.id=868cf3d873a349d1bc43e309a9a6acc2&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:34.313984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:34.441393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:34.447208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09326a-a8f3-4db5-900f-6e055fb12060 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:34.492634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:34.493371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.493547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.493782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.506231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c937b95b-3de1-44a8-8082-72379994e266 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:34.513008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:34.513877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:34.515342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 282/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:34.519881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:34.640964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753af3-6151-480f-9823-6e473c107e3f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.641326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753af3-6151-480f-9823-6e473c107e3f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.641565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae753af3-6151-480f-9823-6e473c107e3f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.643143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 283/545] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:34.650184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517abd-9e20-4971-be40-ec691b10606d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.651663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517abd-9e20-4971-be40-ec691b10606d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.652307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14517abd-9e20-4971-be40-ec691b10606d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.672211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3899db-ad89-4a54-94b2-7c6eb773af06 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:34.677789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-14517abd-9e20-4971-be40-ec691b10606d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:34.679242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-14517abd-9e20-4971-be40-ec691b10606d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:34.744282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:34.745561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.748527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.749061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.749919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:34.750435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:34.753118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:34.771036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 263/546] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:34.774232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 284/547] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:34.776516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:34.804140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:34.889704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810c138d-1bb6-47d3-aaf3-85725a5299d1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:34.932422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:34.933454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:34.933933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:34.934409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:34.946354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:34.948288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:34.964578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:34.965475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:34.966320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:34.966320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:34.966320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:34.968428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 264/548] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:34.973632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517abd-9e20-4971-be40-ec691b10606d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.078948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.097892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14517abd-9e20-4971-be40-ec691b10606d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.143445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.144420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.144960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.145458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.146331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:35.146838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.149020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.165437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 285/549] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:35.170844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.251533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.256700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.280180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795b7d1-800a-45eb-8d96-c3b806ad9518 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.316098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.317248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.317755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.318214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.327015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.328779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:35.340697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:35.342144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:35.343207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:35.345901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 265/550] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:35.350891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.461000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fad25a-1192-48f8-9e56-c2d2691b7d49 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.465803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ba67d-616d-4d21-b772-4cf9acea40b5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.496995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.497425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.497710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.497988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.502856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.503729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.504204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.504704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.505738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:35.506326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.508629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.509519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:35.510978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4a9f2819-7a5a-49ca-bbb2-96b37e404f8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:35.515533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:35.516503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:35.518087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 286/551] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:35.518782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137316-7c12-479c-8d8c-45aceebed0b9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.518782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137316-7c12-479c-8d8c-45aceebed0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.519157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c137316-7c12-479c-8d8c-45aceebed0b9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.520433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 287/552] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:35.525679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.525968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.526365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.534444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 266/553] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:35.535596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.545027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:35.546109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:35.548314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.623264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 288/554] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:35.624161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.643223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2d123-1eb1-4064-931e-d395e8d63169 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.698077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.699187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.699688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.700157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.701166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:35.701665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.703215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.716507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 267/555] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:35.727522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:35.766586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a9f87-6df4-44e4-a8f7-58f7f9504b03 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.796233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.833509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.834133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.834420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.834696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.846503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:35.849750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e917eb-4664-445e-b635-168c599b2765 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:35.889048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:35.889917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.890340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.890754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.902541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.904370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5d4cb2d4-c1b7-475b-b05e-e2390f816f1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:35.920460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:35.921460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:35.922340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:35.922340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:35.922340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:35.923048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:35.924589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 268/556] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:35.924709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26b8123-8a39-4f00-adae-1e0ccae03758 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:35.926192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010af-7a8f-4f03-9994-e076d1deda5e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:35.926663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010af-7a8f-4f03-9994-e076d1deda5e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:35.927269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d010af-7a8f-4f03-9994-e076d1deda5e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:35.929987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 269/557] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:35.930940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d010af-7a8f-4f03-9994-e076d1deda5e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.041099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 289/558] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:36.042429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.042715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.042986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.055133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d010af-7a8f-4f03-9994-e076d1deda5e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.062975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.064410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:36.066226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:36.093444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.094156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.094437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.094883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.095547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:36.095772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.097325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.097975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.112972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 270/559] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:36.113808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.148531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 290/560] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:36.148531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.230208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2285f-78d6-42ff-ab8a-6b97f4a9b90d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.266152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.266889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.267228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.267568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.280867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:36.285499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.286428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 271/561] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.287821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.290403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6199f71-9fdf-471e-bfa1-253d9942bdab None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.317551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.341444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.342625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.343394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.343887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.356820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.359458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:36.382163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.383682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:36.384611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:36.384611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:36.384611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:36.384611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 291/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.390069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.420312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.427871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e121cf-f420-41b3-a923-c1502b0a4b55 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.465549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.466428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.466710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.466992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.474275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.475716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:36.487257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.488465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:36.489437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 272/563] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.490030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.516808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaea501-819f-4629-abd3-bb65971795c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.552484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.553093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.553377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.553653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.554317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:36.554624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.555989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.563994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 292/564] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:36.564817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.592035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.609691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984923-e199-4f72-8c60-9bfc2ca6b8f0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.647129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.648654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.648931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.649205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.650070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:36.650302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.651669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.651953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.669086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 273/565] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:36.669086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.677049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2374226a-14c0-45dc-b157-d49e4a302153 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.712007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.712672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.712953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.713228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.723419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:36.728641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.730724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 293/566] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.731578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.769247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efa35d-2dc0-432d-96f6-16c0b6c4b4e3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.802346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.802945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.803220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.803495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.804734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:36.805291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.806876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.824145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 274/567] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:36.824976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.828187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.835633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf1fc8-dbc6-4ada-8c45-95bfe9a6fb10 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.868607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.869232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.869507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.869776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.880864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.882361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.884540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ee84e6fa-59f2-41c2-9374-48cd6407cd62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:36.897685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.898709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:36.900046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:36.900046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:36.900046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:36.900046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 294/568] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.900046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818387-9cad-416f-b627-f3ae8ffbd816 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.900340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818387-9cad-416f-b627-f3ae8ffbd816 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.900526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd818387-9cad-416f-b627-f3ae8ffbd816 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.901788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 295/569] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:36.902490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818387-9cad-416f-b627-f3ae8ffbd816 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:36.924233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6c483-50cd-46f2-8061-20cc40187537 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:36.958914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:36.959463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:36.959735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:36.960001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:36.966609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:36.968051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:36.978618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:36.979703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:36.980636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 275/570] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:36.981231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.011576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd818387-9cad-416f-b627-f3ae8ffbd816 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.044550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.045621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.046315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.046635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.046927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.047589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.047892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.049323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.057684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 296/571] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.058477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.084231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f6c1d-488e-4040-ab78-553691c30f48 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.112890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.118736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.119368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.119649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.119922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.130679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.132123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-32056bb9-6d91-4750-81d7-7ee7586a1c77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:37.145845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:37.146835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:37.147730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:37.147730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:37.147730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:37.147730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 276/572] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:37.148379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.148564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.148817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.159066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c451a8d-66fe-4ca3-9653-b2092377c3ee None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.166874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:37.168092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:37.194297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.194893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.195168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.195439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.196067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.196443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.197766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.209071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 297/573] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.209788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.233983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 277/574] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:37.234842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.294396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.315700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31469160-cd05-4f9c-af8a-b83ce088385f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.332214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.352204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.352965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.353283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.353569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.354256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.354568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.355993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.356786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6eb45-cd5a-436b-8e03-0baf2cd309fa None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.370452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 298/575] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.371269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.402734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.405792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.406400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.406860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.418153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.419884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:37.436946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:37.437922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:37.438819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:37.438819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:37.438819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:37.438819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 278/576] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:37.438819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.484467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872a03b-3e51-4fc4-8298-cad20a08f0cc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.523203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.524138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.524629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.525088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.526153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.526610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.528985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.546946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 299/577] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.547806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.559514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.563551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bce6ac-5b72-426d-bb7e-03ea3c83300a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.583241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.598467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.599094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.599371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.599641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.606974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.608457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:37.619599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:37.620790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:37.621750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 279/578] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:37.622339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.650097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62c294-75f7-4b4a-b43f-7fcc3e06fb13 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.684953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.685549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.685826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.686100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.686806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=187876bda81c4d66a857ba9d8c4affaf) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.687115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.688562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.693743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 300/579] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/role_assignments?user.id=187876bda81c4d66a857ba9d8c4affaf&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.694514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.732167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bad3c-c6fd-44e7-a135-8441a82b269c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.771307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.772188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.772681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.773162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.774116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:37.774703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.776107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.794225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 280/580] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:37.795055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.803272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.807780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d882b5f8-4ccf-4b84-bb86-4c94e7e1ea66 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.817228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:37.845858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.846492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.846770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.847040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.858308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:37.863079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:37.863995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:37.864894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 301/581] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:37.865583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:37.923661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c2151-e7aa-4303-9129-75a5f05f7a3c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.961786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:37.962482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:37.962788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:37.963032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:37.969550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c860f543-cbaa-4f7a-ba95-c07e3e87436d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:37.969974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:37.971442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:37.983487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:37.984440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 281/582] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:37.985367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.011897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.012543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.012826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.013103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.013823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.014130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.015561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.033253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 302/583] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.038104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.058811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.070966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.095512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395cfd7-e455-46d4-b2ba-be9bb9fcbefc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.135132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.135938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.136294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.136688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] PATH_INFO: `/v3/users/glance` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.143910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.145559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.149707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a818-bc16-43be-9f9b-a7f0dbcff314 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:38.157974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:38.159139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:38.160276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:38.161355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 282/584] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:38.166450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.191857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.192639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.192993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.193328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.193988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.194283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.195674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.208507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 303/585] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.208507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.276728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267e116d-1c39-4a0a-94a1-42210fc7acee None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.295400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.313243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.313901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.314246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.314581 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.315327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.315605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22e48a-c68f-4f08-a715-4a14e721bd32 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.315758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.317282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.325246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.333440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 283/586] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.334508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.361549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.362182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.362459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.362732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.373314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.374750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:38.391088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:38.392250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:38.393403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:38.393403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.393403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:38.394860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 304/587] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:38.400370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.458162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7112f3-091e-4e40-8afc-99ed344ac875 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.497199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.497796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.498071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.498340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.499064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.499388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.500827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.512688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b28cf-7e7e-4131-bca4-247764fb4ae5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.517621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 284/588] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.518408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.546224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.552592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.553502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.554235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.554703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.565648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.567213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.580442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:38.582312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:38.583370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:38.584423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:38.584423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.584423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:38.588763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 305/589] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:38.589487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.630697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42961ac4-600b-4afa-b226-4546733ff2ce None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.667626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.668314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.668620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.669218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.685140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=02cff3a52a8e47feb0acc62f084f110a, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.686564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.693288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215e3dba-7ca1-4cfc-ab5d-8583371e959c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.701461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 285/590] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:38 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:38.702452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.751561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.752775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.752775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.753050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.754495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.755034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.758773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.778637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 306/591] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.780241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.836470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ee725-fe57-444b-b07b-6774e2a15241 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.844791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.845450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:38.889662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.890572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.890848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.891191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.903934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.905542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.914828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466cab52-5063-4c67-a1da-f73c7231ed30 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:38.926824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:38.927777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:38.928691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:38.928691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:38.928691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:38.929379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 286/592] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:38.929919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:38.955292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:38.955932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:38.956213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:38.956523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:38.957181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:38.957485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:38.959596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:38.975574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 307/593] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:38.980554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.057198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700574a-8069-4451-9f53-2e1c8b3818ca None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.098378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.099264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.099821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.100097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.108016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00554ac-fd1b-4520-8663-81dee5c3a9dc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.108501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.110041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.110523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:39.125300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:39.126280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:39.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 287/594] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:39.127684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.153453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.154833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.155583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.156039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.157106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:39.157971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.160041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.160717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.177764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 308/595] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:39.179625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.255758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3124bf4b-d0ff-45be-ad2a-ebcf8da7ff5e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.297596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.298235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.298492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.298748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.308719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.310166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.312442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877a6fb1-8c42-4bcf-86a0-7f2d9306ba19 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:39.326961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:39.327947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:39.328914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:39.330364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 288/596] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:39.331533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.357406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.357965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.358325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.358587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.359319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:39.359631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.361112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.374396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 309/597] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:39.375304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.408041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.420865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.444164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346bb1-09f7-4e5c-b748-a0931b680918 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.478721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.479738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.480213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.480694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.487782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.489467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.494058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcecc753-a8f5-4944-80dc-23789d6d6210 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:39.501841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:39.502775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:39.503667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:39.506085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 289/598] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:39.507139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.531836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.532470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.532753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.533030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.533873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:39.534182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.535785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.560923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 310/599] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:39.561742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.612160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9293c8-0c10-4220-97ed-3773a92f92d1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.647030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.648076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.648610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.649080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/23232654097d435a9ebe540ada43804d/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.652480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.659086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.666781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=23232654097d435a9ebe540ada43804d, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.668235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.676319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d44cb87-c644-4af3-9ef9-2000a9abfdaa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.681409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 290/600] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:39 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/23232654097d435a9ebe540ada43804d/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:39.682205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.729359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.732385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.732851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.733196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.734473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:39.734855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.736720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7fe1ac-5ad3-4248-9ce0-7ff59abbe06e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.756909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 311/601] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:39.758968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004305e-d6ca-41d3-aa04-9ad8e68dbb57 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.759254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004305e-d6ca-41d3-aa04-9ad8e68dbb57 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.759578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b004305e-d6ca-41d3-aa04-9ad8e68dbb57 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.761274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 312/602] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:39.762594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004305e-d6ca-41d3-aa04-9ad8e68dbb57 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:39.825193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f806f3-2798-4a3f-aaf1-3097d6bfad33 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.875583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.876153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.876509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.876788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.888790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.890266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-2271c9a1-6cf9-4d13-aaf4-d69a6e1018c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:39.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:39.907074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:39.908216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:39.908216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:39.908216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:39.908216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 291/603] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:39.908216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835397d-e55d-4800-b841-22309687b747 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.908579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835397d-e55d-4800-b841-22309687b747 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.908648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835397d-e55d-4800-b841-22309687b747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.911695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b004305e-d6ca-41d3-aa04-9ad8e68dbb57 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:39.927373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0835397d-e55d-4800-b841-22309687b747 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:39.928692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0835397d-e55d-4800-b841-22309687b747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:39.961447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:39.963009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:39.963735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:39.964172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/bf080f10671b4fd8aaf6e232d5f8b2f3/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:39.969716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.981623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:39.986635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=bf080f10671b4fd8aaf6e232d5f8b2f3, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:39.988632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.011216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 313/604] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:39 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/bf080f10671b4fd8aaf6e232d5f8b2f3/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:40.012261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.039403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 292/605] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:40.139766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2dcff-7d0b-4d63-8811-c388d42918f1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.180193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.181258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.181889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.182394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.183272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:40.183741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:40.185364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.205839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 314/606] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:40.212242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835397d-e55d-4800-b841-22309687b747 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.326606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835397d-e55d-4800-b841-22309687b747 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.385322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.385994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.386282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.386559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.394410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:40.395798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:40.408527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:40.409478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:40.410367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 293/607] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:40.416121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.473559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.494188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:40.530249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:40.557903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5f77d4-f3b2-4e24-81a5-9dcb862d76c4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.624722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc995f51-f43b-45e3-bf44-497a21b7a067 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.661118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.661665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.661945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.662222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.662534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.662928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:40.663238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:40.664222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.664679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.665112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.665440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.676623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:40.682107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:40.683224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:40.684302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:40.686799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 294/608] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:40.690831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 315/609] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:40.696602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.698028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.813432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:40.826451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf13c45-4687-477c-b2d3-bedc4d4c1ae8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.876659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.877457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.877839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.878971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.879734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:40.880764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:40.882882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960ee71d-6c3c-4e33-a783-6d0ef15e15f2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.895668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbc3f0-706b-4b6f-8d00-c40de00f66ea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:40.896141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 295/610] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:40.898411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26260d-e226-4ba0-8fc8-8af28280d9bd None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.899791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26260d-e226-4ba0-8fc8-8af28280d9bd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.900226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26260d-e226-4ba0-8fc8-8af28280d9bd None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.901741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 296/611] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:40.902648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26260d-e226-4ba0-8fc8-8af28280d9bd None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:40.912089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:40.945652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:40.947567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:40.948031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:40.948514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/868cf3d873a349d1bc43e309a9a6acc2/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:40.970122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=868cf3d873a349d1bc43e309a9a6acc2, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:40.972353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c27366a-cb92-434f-90d3-9c24516fb0fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:40.992406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 316/612] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:40 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/868cf3d873a349d1bc43e309a9a6acc2/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:41.002158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.004465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.004698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.042705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:41.045068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:41.050901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d26260d-e226-4ba0-8fc8-8af28280d9bd None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.121626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:41.122532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.123804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.124186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.147258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:41.149629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:41.177813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:41.178859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:41.179798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:41.179798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:41.179798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:41.179798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 297/613] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:41.184381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.188780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 317/614] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:41.190658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:41.293096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b96643-1606-45f8-a38f-e0d4d1cb635c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.329042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:41.329699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.329962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.330198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.330856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:41.331169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:41.332585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:41.345959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 298/615] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:41.351831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.513391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:41.513830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.518520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a21e8-c8e5-4c53-bbac-6bce94fe1fb3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.590791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:41.591483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.591767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.592039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.605030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:41.606476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:41.624240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:41.625270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:41.626220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:41.634024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 318/616] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:41.639425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.653981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed72148-2fd0-428b-a48d-10a1f8b147bb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.656777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:41.703499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:41.704155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.704455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.704735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.722936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:41.740220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:41.741390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:41.742619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 299/617] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:41.754387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.777608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b6923-a289-4683-af32-6dc7c835c307 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.818799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:41.819418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:41.820236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:41.820535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:41.821275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:41.821576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:41.823052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:41.863299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 319/618] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:41.864764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:41.886972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:41.965726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2246-097e-4eb0-abf3-af333cbcf678 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:41.997017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.013242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.014099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.014523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.014952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.016285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:42.016759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.018872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3774a-4c76-4257-b4e2-b5303e52c996 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.028270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd773d-79ec-4e92-a7ff-577a49da36e3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.031888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 300/619] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:42.033464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d1e7-4d5c-456d-9376-f31d4e7e2693 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.033898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d1e7-4d5c-456d-9376-f31d4e7e2693 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.034342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b47d1e7-4d5c-456d-9376-f31d4e7e2693 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.036871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 301/620] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:42.037822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d1e7-4d5c-456d-9376-f31d4e7e2693 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.074347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.075591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.076249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.076696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.087679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.089366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bc51593f-5ce0-4fc9-b720-4c0c14ee2f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:42.104895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:42.105930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:42.106830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:42.106830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:42.106830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:42.112914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 320/621] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:42.114408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81365-c190-495c-b85e-71e95427d341 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.114912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81365-c190-495c-b85e-71e95427d341 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.115186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e81365-c190-495c-b85e-71e95427d341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.134747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-44e81365-c190-495c-b85e-71e95427d341 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:42.135946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-44e81365-c190-495c-b85e-71e95427d341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:42.165619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b47d1e7-4d5c-456d-9376-f31d4e7e2693 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.194386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.206053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.207040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.207599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.208138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.212667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 321/622] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:42.213601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81365-c190-495c-b85e-71e95427d341 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.220558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.222401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:42.237729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:42.238744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:42.239625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:42.239625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:42.239625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:42.243537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 302/623] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:42.249280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.311753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.368155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e81365-c190-495c-b85e-71e95427d341 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.406546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b884bb-aa75-4a4a-a3fb-022121d4318a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.423776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.424771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.425200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.425624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.426448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:42.427029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.428622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ea5be7-8c4f-41db-bd90-cceeb9564300 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.442087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 322/624] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:42.442261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.442793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.443078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.443419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.444077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:42.444330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cc6a-4759-4f39-b17b-982a73cfee77 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.444477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.444975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cc6a-4759-4f39-b17b-982a73cfee77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.445455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003cc6a-4759-4f39-b17b-982a73cfee77 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.445923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166793a-4bf3-4a30-8c21-10ebaa5df566 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.447698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 323/625] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:42.448920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003cc6a-4759-4f39-b17b-982a73cfee77 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.459515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 303/626] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:42.464475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.464475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.464475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.481414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:42.482630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:42.519158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.559639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 304/627] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:42.560523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.579361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003cc6a-4759-4f39-b17b-982a73cfee77 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.598437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.620358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.621388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.621906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.622497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.630376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.632122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:42.644985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:42.645910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:42.646809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:42.650441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 324/628] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:42.651540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.687748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d183c5b-03db-4e64-b5a7-f9a8926798d4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.738389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.739033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.739318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.739593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.748460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.750644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:42.767149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:42.768151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:42.769204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:42.773141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 305/629] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:42.774353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.779679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d74c21-a86b-40c3-a22e-52308bccbdea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.795137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.820000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.821056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.821591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.822208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.834466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:42.840098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:42.841114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:42.841998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 325/630] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:42.842709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.887948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:42.902871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c53c4-877a-4e2c-8e47-a06de23d86dd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.940087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.940726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.941122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.941397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.942202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:42.942511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.943951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:42.944686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02842186-9cef-42be-bff4-12ee6b9c54d4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:42.961878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 306/631] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:42.961878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:42.985398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:42.986118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:42.986464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:42.986805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:42.987597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:42.987977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:42.989439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.013226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 326/632] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:43.013226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.041780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.077229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdac37c-290f-4898-b599-fd39541bc7ea None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.113174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.113705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.113985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.114252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.122856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07424f2-c2a0-4e4c-b736-8ff6e77ae173 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.124748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:43.129361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:43.130312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:43.131157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 307/633] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:43.131865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.144550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.165846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.166872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.167244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.167759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.168852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:43.169417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.170783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.185016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 327/634] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:43.185838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.253452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8ed954-d98e-4b87-a6df-570a837db114 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.289116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.292142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.293055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.293341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.293938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/187876bda81c4d66a857ba9d8c4affaf/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.299657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c54e1a-f9fe-45e4-bbbb-6df420c842e2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.308942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=187876bda81c4d66a857ba9d8c4affaf, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.310391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.323634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 308/635] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:43 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/187876bda81c4d66a857ba9d8c4affaf/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:43.324460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.337618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.338365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.338594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.338874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.400852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.420517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.422092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839291f3-f9be-4a3c-a829-e4e977a2a174 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.452663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b5219-3f1b-4eb2-b11d-642289b07739 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.496940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.497713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.498086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.498441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.499181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:43.499550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.501104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.510330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 309/636] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:43.511199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.530644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.544597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 328/637] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:43.546014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cea6-d64f-41d3-b0fc-570904992760 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.546364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cea6-d64f-41d3-b0fc-570904992760 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.546705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0cea6-d64f-41d3-b0fc-570904992760 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.548282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 329/638] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:43.549054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cea6-d64f-41d3-b0fc-570904992760 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.621273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8a0dd-536d-46ed-a1fc-9db80c099bcf None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.644207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.656011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0cea6-d64f-41d3-b0fc-570904992760 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.660212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.660956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.661290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.661638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.672964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.674520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:43.689255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:43.690409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:43.691497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:43.691497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.691497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:43.697239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 310/639] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:43.697239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.699718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.700469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.700854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.701224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.712174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.713644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3ab303f3-39dd-45e2-91db-080e28d81dde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:43.728185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:43.729215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:43.730100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:43.730100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.730100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:43.734213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 330/640] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:43.735653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.735934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.736341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.755718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:43.757032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:43.806039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.818009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c099b7b-fc45-47d4-867d-f88d19e02cc7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:43.836468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 331/641] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:43.837334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.881915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:43.882567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:43.882841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:43.883160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:43.898117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:43.900208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:43.921354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:43.922392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:43.923325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:43.923325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:43.923325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:43.924547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 311/642] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:43.925368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:43.953991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:43.962842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ffeba-5e62-46c9-aa42-08e4f76373e1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.004534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.005396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.005743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.006126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.006837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.007232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.008725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.020690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 332/643] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.021739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.051876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537aa3-9284-46f2-b987-b099d4207864 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.057976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.111457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.112075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.112787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.113068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.114003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.114306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.117107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.133262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 312/644] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.134025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.140961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a64157-d3c3-455c-9a03-867830c52cef None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.177100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.177739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.178023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.178290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.179507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.179799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.181193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.193333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 333/645] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.194138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.226963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.243068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc029d9-5c26-4b98-87e3-566707f03788 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.278230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.278863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.279144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.279421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.286699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.288769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.301065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:44.304274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:44.305512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:44.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 313/646] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:44.307295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.314043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f6d6d-9e29-4891-99c7-feee48ef6bce None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.349048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.349700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.349977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.350246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.362756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:44.368100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:44.369139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 334/647] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:44.369996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.432093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227bce9a-eae3-4eb2-95a9-98abfe5fde60 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.468860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.469667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.470043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.470774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.479476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.480995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.483743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0665c68-459a-4d01-b7b2-7d5b5ab74f33 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:44.492925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:44.494660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:43:44.496507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:44.498771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 314/648] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:44.499608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.504510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.521303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.521925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.522343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.522453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.529826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.531161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:44.542813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:44.543938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:44.545316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:44.548697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 335/649] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:44.549529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.566066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.614202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36fad7-83ac-4f67-ac1b-7fe6f01e5f49 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.654176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.654785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.655064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.655335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.656065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.656369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.657815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.659740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ad968-7d14-44e1-a53b-ba701b625ffb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.675867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 315/650] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.676725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.700453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.701005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.701266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.701536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.702187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.702489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.703869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.712436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 336/651] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.713234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.748980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.788540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ceada-c84d-4aeb-aaa4-4d65e0a01cfd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.799064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.823246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5cce7d-7b52-4a30-be3e-da45c52368fe None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.824766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.825435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.825716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.825992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.826720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.827016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.828445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.851250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 316/652] 10.222.0.64 () {56 vars in 1137 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.851250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.864927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.865619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.865968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.866344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:44.867371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:44.867678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:44.869137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:44.881173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 337/653] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:44.885297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:44.956549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ac455-bd70-444e-ae58-3a16e65807e4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.976955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:44.990446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3367875-e078-487e-8ebc-854ed49a5da5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:44.992679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:44.993285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:44.993557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:44.993880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.027162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.027790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.028063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.028333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.031360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.039204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.041086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:45.055846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:45.057425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:45.058327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:45.058327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.058327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:45.058327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 338/654] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:45.058327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.071947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.073472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.170116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599dd0be-7cb7-4dee-9e18-0c9cdc98843e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.186119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 317/655] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:45.186119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.208100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.209009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.209700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.210139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.210445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.266157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.278618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.280083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.289087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57d31a-cfb4-42fa-9c11-517b5b6f1456 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.322773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.323368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.323643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.323916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.324656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:45.324960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.326377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.331932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 318/656] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:45.332743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.385439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 339/657] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:45.386322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.450492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.468530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee48085-496a-4b09-9996-6101b385acf3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.497010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.509385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.510554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.510832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.511732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.511732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:45.512038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.512138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cbb1f-2751-49d2-a41a-a71d18e47fcb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.513446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e9df8-2125-4570-884e-85d0ddfda57b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.526943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 319/658] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:45.529084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6f-696d-4c1f-8a3f-2e64d83c0b40 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.529366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6f-696d-4c1f-8a3f-2e64d83c0b40 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.529635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57bd6f-696d-4c1f-8a3f-2e64d83c0b40 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.530861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 320/659] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:45.531555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bd6f-696d-4c1f-8a3f-2e64d83c0b40 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.558375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.559268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.559698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.560147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.571116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.573255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2c94b67c-30f4-4b2c-b28f-656f04522a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:45.589048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:45.590235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:45.591317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:45.591317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.591317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:45.591317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 340/660] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:45.591666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.591947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.592219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.610728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:45.611923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:45.650245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57bd6f-696d-4c1f-8a3f-2e64d83c0b40 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.685208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.685853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.686137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.686416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.696768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 341/661] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:45.696982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.698030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.698557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.702064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:45.717587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:45.718835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:45.719976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:45.719976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:45.719976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:45.723623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 321/662] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:45.724631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.784335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.821961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b65a3-b655-43af-9f3c-871cacbd96c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.844247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eceeb-b021-45d6-862c-073bd6e0e6d0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:45.858567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.859432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.859967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.860408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.868257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.869906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.881815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:45.882431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:45.882712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:45.882991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:45.883102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:45.884174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:43:45.885336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:45.885891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:45.885891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:45.885891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:45.887638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 342/663] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:45.888686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.904148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 322/664] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:45.905146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:45.969658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:45.996311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d8f3f-be2a-45cc-8bcb-0c397893f63c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.016616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72e54f-36b0-4b65-8f73-933b0ee2b54e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.029259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.035962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.037033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.037413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.037784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.039161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.039563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.041423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.053476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 343/665] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.054382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.058826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.059624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.060055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.060538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.061425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.061732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.063179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.090061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 323/666] 10.222.0.64 () {56 vars in 1139 bytes} [Thu Aug 25 02:43:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.090061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.158740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3edbe5-ab39-4df0-a0e2-021dbe085322 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.195072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.195703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.196079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.196568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.204357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.205865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.215996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c56aae-27a4-4d26-a8f9-5f40f4871c99 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:46.218494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:46.219379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:46.220360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 344/667] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:46.220905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.234870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.258763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.259492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.259773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.260080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.273698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:46.275929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:46.279209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:46.280545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:46.281400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:46.284542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 324/668] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:46.285731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.336519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a437f8c-2e37-45e0-a63f-f0091cbd6e8e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.375995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.376659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.376935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.377208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.389022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.390608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:46.402576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:46.403644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 345/669] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:46.405231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.421578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698669f-2f84-4869-831c-bfb5ac1ce7ec None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.466227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.466838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.467118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.467391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.514807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.516481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008720c-87fb-4256-8388-0f1a8d3c0465 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.527422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.547123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.548646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.551535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.552143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.552440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.552716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.553399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.553729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.555154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.573048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 346/670] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.573048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.659392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 325/671] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:46.660411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.684966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4a0c6-ce46-449e-bb80-ce9b4bb0615d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.720794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.721406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.721688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.721966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.722622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.722924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.724305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.732697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 347/672] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.733506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.746977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.767731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:46.775378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fda327-1e7f-48e5-b243-4a9c367ae3fc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.815103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.816020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.816293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.816594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.817294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.817595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.819028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.835293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 326/673] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.836143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.848163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac55c01f-f92e-4285-be5d-f3a4cd6530cc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:46.888249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:46.888980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:46.889324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:46.889743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:46.890383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=23232654097d435a9ebe540ada43804d) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:46.890693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:46.892123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:46.904441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 348/674] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/role_assignments?user.id=23232654097d435a9ebe540ada43804d&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:46.904441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:46.974949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1df2395-892e-4242-a886-8c4f44bd7d9e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.026360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.027363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.027820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.028282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.031207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.039213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.047602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6f06c-1ca8-4eee-95c8-fe855aadc920 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.048656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.050358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:47.068093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:47.069395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:47.070503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:47.070503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:47.070503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:47.073071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 327/675] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:47.074122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.112549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.113209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.113494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.113784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.129051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.130818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:47.152748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:47.153779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:47.154654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:47.154654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:47.154654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:47.154654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 349/676] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:47.154886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.225201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debe80b-4716-4324-8cef-a568d68d44f2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.269058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.269966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.270248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.270517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.271310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=bf080f10671b4fd8aaf6e232d5f8b2f3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:47.271621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.274381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.282034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 328/677] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/role_assignments?user.id=bf080f10671b4fd8aaf6e232d5f8b2f3&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:47.282822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.288722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5e8d0-c41f-4dda-9a34-3921a68f2678 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.340654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.358130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.358818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.359100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.359373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.360187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:47.360540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.362082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bae08-2ac4-4a21-a8f5-4c1fa15dd982 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.376895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 350/678] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:47.378401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594e9b-d012-4100-87d8-3a8f6053809f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.378690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594e9b-d012-4100-87d8-3a8f6053809f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.378961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21594e9b-d012-4100-87d8-3a8f6053809f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.392420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 351/679] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:47.392420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21594e9b-d012-4100-87d8-3a8f6053809f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.398464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.403637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815367e1-7910-4ca4-a53c-ed9219c44809 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.455674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.457001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.457001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.457001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.457496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:47.457795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.459234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f6fea5-0405-407f-b6c1-a2593a540788 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.474354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 329/680] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:47.476260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.476612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.476962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.497923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:47.499104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:47.528621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21594e9b-d012-4100-87d8-3a8f6053809f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.579320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.579868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.580153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.580461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.588896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.589828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 330/681] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:47.590616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.591414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:47.606314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:47.607264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:47.608216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 352/682] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:47.613219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.641435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.705199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc41d3d-636a-4b5c-b16d-e7ea728dbeea None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.706534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.750484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.751166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.751542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.751888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.754519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1239b3-2998-4afa-b16d-e065b015c934 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.761513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.762982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:47.776711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:47.777696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:47.778650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:47.782516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 331/683] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:47.783787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.809774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.810389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.810669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.812295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.813901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:47.814215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.818378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:47.848551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 353/684] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:47.865842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:47.937713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:47.941100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078991d1-4a07-4a3f-a34a-648ca4611b89 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:47.979480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:47.980172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:47.980473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:47.980749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:47.981491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:47.981797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:47.983613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.008098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 332/685] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:48.009172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.038960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90ca2-f7a1-477e-812b-f24525259231 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.065840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.074887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.075806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.076293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.076814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.077743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=868cf3d873a349d1bc43e309a9a6acc2) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:48.078244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.079863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.086812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 354/686] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:47 2022] GET /identity/v3/role_assignments?user.id=868cf3d873a349d1bc43e309a9a6acc2&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:48.087862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.166864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbde677-714f-4112-abea-5ce86b825bb0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.204763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85228f67-02ef-4623-b870-520999fad7f2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.246489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.250563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.250883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.251172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.258811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.259768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.260253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.260770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.271009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:48.280062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:48.281224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:48.287132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 333/687] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:48.288903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.313575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.340803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.349808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.352327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.417660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa2a53a-78ab-4fea-9b20-7539dbe42a87 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.456296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.456938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.457220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.457494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.458160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:48.458462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.461292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.469687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 355/689] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:48.470144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 334/689] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:48.476146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.478256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.570259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.592449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90248d8-578e-48c7-8ee0-e0aec31bcb58 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.600726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.613731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20f978-56e6-4839-8e56-64f4c2459b81 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.634361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.635628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.636378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.636874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.650986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.653047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:48.672352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:48.673346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:48.674259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:48.674259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:48.674259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:48.676789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 335/690] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:48.684578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.690379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.692012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.700656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.700970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.726894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.728899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:48.761040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:48.762271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:48.763393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:48.763393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:48.763393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:48.767588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 356/691] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:48.774353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.856948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dc4244-6fc2-455e-b3d5-f22d4df98c78 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.913725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:48.920938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.921889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.922467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.922959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.923805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:48.924309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.925924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:48.940170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 336/692] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:48.946778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:48.950848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca56620-39c5-4d7f-b0fa-9edbf3a32d98 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:48.989486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:48.990090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:48.990372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:48.990639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:48.992056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:48.992361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:48.993751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.019394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 357/693] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:49.023745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.034035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.109943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d928db-b2a0-473b-868b-53512fe13a26 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.150296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.150952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.151231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.151777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.159831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.161869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:49.175324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:49.176306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:49.177337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:49.181147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 337/694] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:43:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:49.183275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.257678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c69c40-28cd-437d-a8b8-288f3b68ae35 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.277246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.329227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.329861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.330142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.330411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.340448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.342072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-894c0f5f-bbcd-455c-956d-b531c6322b5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:49.357000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:49.357882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:49.358806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:49.361177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23c176-6be1-4eb5-9033-8606e84005cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.363361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 358/695] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:49.365563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7661-e207-43b1-aeaf-5e69443a0f3f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.365848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7661-e207-43b1-aeaf-5e69443a0f3f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.366956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c7661-e207-43b1-aeaf-5e69443a0f3f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.368587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 359/696] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:49.369307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c7661-e207-43b1-aeaf-5e69443a0f3f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.408862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.409469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.409749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.410018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.410747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:49.411048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.413600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0792e454-8c8f-4cd5-81a9-69d2e2f9cb08 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.434304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 338/697] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:49.439031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.439031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.439031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.448043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.457034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:49.458481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:49.489526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c7661-e207-43b1-aeaf-5e69443a0f3f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.525561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.526252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.526533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.526855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.527546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:49.527849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.529480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.540668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 339/698] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:49.542006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.543363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 360/699] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:49.549200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.607883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.671699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25667f4-88d9-4cc4-ac1c-92d02943eec8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.683943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b91b45-b2e8-4929-aa55-4e12026b2fe6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:49.708882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.709406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.709707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.709989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.710716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.723541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:49.724457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.725036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.725562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.726883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=187876bda81c4d66a857ba9d8c4affaf) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:49.727399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.729271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd6219-4806-464a-b1c5-5c7e1611dc67 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.736019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 361/700] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/role_assignments?user.id=187876bda81c4d66a857ba9d8c4affaf&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:49.737590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96843-c017-4979-9453-be3321917dc4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.738147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96843-c017-4979-9453-be3321917dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.738699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f96843-c017-4979-9453-be3321917dc4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.740421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 362/701] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:49.751038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:49.751038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:49.751038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:49.789730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:49.791001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:49.835477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:49.837025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:49.894406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:49.903776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 363/702] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:49.904972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:49.975534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 340/703] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:49.982012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.015658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574a2df-a006-4ceb-a752-d2bbd10459aa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.036949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.056982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.057631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.057913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.058303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.058973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.061184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:50.073190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:50.074455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:50.075484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:50.080425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 364/704] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:50.083794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.127005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bf531-430b-42ee-a937-5ccdbf6b8e24 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.167838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.168790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.169230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.169724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.179136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.183268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.184935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.199200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807312fb-caf0-459d-b3b1-097a9a4316cb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:50.201943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:50.202989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:50.204062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:50.204062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:50.204062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:50.205775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 341/705] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:50.212285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.237338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.238052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.244880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.245276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.246047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:50.246461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.248222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.255763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 365/706] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:50.263882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.326358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.345081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7d41-a3eb-4198-b8c2-eccc11c0b042 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.392973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a2a34-778b-438b-a631-fe4626324719 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.393496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.394310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.395044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.396427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.397317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:50.397797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.399365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.415692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 342/707] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:50.417195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.442859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.443929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.444968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.445485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.446349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:50.446881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.448617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.454924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 366/708] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:50.456052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.478823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.534601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805addb-eea9-41f8-ad26-74df9f9044a4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.579166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.579855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.580415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.580710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.588172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b5d70-145f-4793-a807-7261670f2059 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.595347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.597442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.604010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-69d55f88-851f-426a-ac04-86db7c770343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:50.617455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:50.618772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:50.620084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:50.620084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:50.620084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:50.620084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 343/709] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:50.620084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639d9-fd1f-4391-bee2-982634ed00bf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.620507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639d9-fd1f-4391-bee2-982634ed00bf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.620697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75639d9-fd1f-4391-bee2-982634ed00bf None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.622156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 344/710] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:50.626940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75639d9-fd1f-4391-bee2-982634ed00bf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.637493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.638467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.638954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.639226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.646756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.648407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4e2da71b-370b-4082-ac8e-ae5649605fcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:50.660017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:50.661247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:50.662536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:50.664176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 367/711] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:50.669774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.670166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.670561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.690232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:50.691574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:50.775887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 368/712] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:50.775887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.782635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75639d9-fd1f-4391-bee2-982634ed00bf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.786170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:50.845130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:50.845741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:50.846013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:50.846290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:50.846929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:50.847228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:50.848680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:50.870980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 345/713] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:50.877193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:50.953644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5bfc2-857d-4482-b2d7-6084f2470ce1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:50.956713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:51.023694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.024357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.024658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.024926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.025619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:51.026002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.027435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.051445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 369/714] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:51.064555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a91a8-f349-45da-885a-5c8eba0e7e31 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:51.073881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:51.111074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.111693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.112024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.112305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.113420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.114882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.141486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 346/715] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:43:50 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:51.144972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:51.193076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:51.281252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e68a4-2447-40da-a1f1-e42f7dec2241 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:51.324585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221b83e-afc7-41b0-9bd3-395e6573cee1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:51.363228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.363843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.364127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.364421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.365448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:51.365808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.367179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.368037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.368146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.368660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.369148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] PATH_INFO: `/v3/services/network` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.370142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.371711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.375250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 370/716] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:51 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:51.390460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:51.391519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:51.392383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 347/717] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:51 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:51.398432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:51.447085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:51.546241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8bad4-4371-4609-83fb-b28bfaa80b77 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:51.585999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.586545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.586824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.587100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.587749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] RBAC: Adding query filter params (name=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:51.588056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.589494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee66d-2afa-42f9-adba-a1d88cfac326 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.594846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 371/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:43:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:51.600288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:51.714891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:51.736266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b534a4-978a-4c2e-97b2-42bf03a79e08 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:51.781274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:51.781886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:51.782168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:51.782442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:51.783076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] RBAC: Adding query filter params (type=network) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:51.783378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:51.784778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b9f95-1f3a-467e-ac52-25196fb3d441 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:51.793449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 348/719] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:43:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:52.134657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e943-e81f-4595-b319-3c14d4758951 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:52.135031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e943-e81f-4595-b319-3c14d4758951 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:52.135212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727e943-e81f-4595-b319-3c14d4758951 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:52.136794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 372/720] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:52.143669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7abd0-f26e-4083-a491-0b96fe88e176 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:52.143957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7abd0-f26e-4083-a491-0b96fe88e176 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:52.144231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7abd0-f26e-4083-a491-0b96fe88e176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:52.168694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f9d7abd0-f26e-4083-a491-0b96fe88e176 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:52.170562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f9d7abd0-f26e-4083-a491-0b96fe88e176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:52.247887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 349/721] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:52.667473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735c84-6b18-4f1e-be20-e8e50fd8e2c8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:52.668251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735c84-6b18-4f1e-be20-e8e50fd8e2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:52.668251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b735c84-6b18-4f1e-be20-e8e50fd8e2c8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:52.669663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 373/722] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:52.675787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:52.676078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:52.676359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:52.700032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:52.701327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:52.704443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b735c84-6b18-4f1e-be20-e8e50fd8e2c8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:52.839586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:52.843177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 350/723] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:52.872576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b735c84-6b18-4f1e-be20-e8e50fd8e2c8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:52.934068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:52.934620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:52.934894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:52.935166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:52.945934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:52.950614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:52.951532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:52.952377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:52.957557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 374/724] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:52.963483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:52.983234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:53.133589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4813de-5dc5-4dec-9b8c-df9051ee694b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:53.169588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:53.181541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:53.182164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.182443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.182716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.183762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:53.184065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:53.185841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:53.203924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 351/725] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:53.204845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:53.343875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1c3a9-69c9-4fe7-9b1c-bd0d5dec5fe0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:53.376746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:53.387434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:53.388056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.388330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.388625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.391803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:53.393218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:53.423271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 375/726] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:43:53 2022] POST /identity/v3/services => generated 251 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:53.428825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba1796-e8fd-4950-9888-31289b9ecf06 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:53.474305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:53.474925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.475776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.476052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.488079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:53.489576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:53.506404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:53.507423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:53.508318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:53.508318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:53.508318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:53.508318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 352/727] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:53.514912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:53.528789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:53.636558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962de73f-31b3-4e45-9e40-cb67320b4e38 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:53.674572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:53.675231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.675459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.675714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.676360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:53.676704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:53.678084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350b7e2-5f27-49f2-8685-16109fe1bcf6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:53.690862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 376/728] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:53.696359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:53.722891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68346-ad79-4fcc-8420-a49d71e0dc73 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.723217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68346-ad79-4fcc-8420-a49d71e0dc73 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.723446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc68346-ad79-4fcc-8420-a49d71e0dc73 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.724856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 377/729] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:53.731769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c53b3-16ea-40de-b301-32d19bd4066e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.732055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c53b3-16ea-40de-b301-32d19bd4066e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.732335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657c53b3-16ea-40de-b301-32d19bd4066e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.756461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-657c53b3-16ea-40de-b301-32d19bd4066e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:53.758013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-657c53b3-16ea-40de-b301-32d19bd4066e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:53.822290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045aece3-1c9a-4db3-855d-17775f7165a9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:53.841387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:53.847718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:53.849711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 378/730] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:43:53.852687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8253-e4e9-477d-9f75-548dd68c647a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.853213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8253-e4e9-477d-9f75-548dd68c647a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.853689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f8253-e4e9-477d-9f75-548dd68c647a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.856349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 379/731] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:53.864796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.865668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.867052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.871078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:53.871791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:53.872140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:53.872515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:53.881879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:53.884287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:53.888879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:53.890219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:53.897427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:53.898575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:43:53.899752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:53.901122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 353/732] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:53.906201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:53.973434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 380/733] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:54.031897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272733ca-2c44-4c68-906d-ab2a8f1a70e2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.066574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.067186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.067465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.067739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.068487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:54.068795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.070500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:54.089221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 354/734] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:43:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:54.094748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.239027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967079ab-3c43-4a02-a404-ae88892f8240 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.266728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.275585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.276259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.280767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.281049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.286316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.337557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.354579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.356042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:54.434789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e125178-a5bb-4e22-a31c-fee06a4054c1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.476855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.477603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.477955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.478308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.492502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 381/735] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:43:54.493395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:54.494008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:54.498554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:54.499516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:54.500371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 355/736] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:54.505089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.530916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.608287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.610820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90846c20-6c3f-45b9-a684-c16499347332 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.614831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8e32f9-64b7-4695-8eee-123d6ef2ca5f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.646068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.646695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.647534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.647806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.654415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.655047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.655327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.655599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.658986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:54.664504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:54.665438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:43:54.666316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:54.666962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.667612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:54.670498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 382/737] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:54.671530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cae457c9-1467-4c30-8faf-5838878328bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:54.683953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:54.685015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 356/738] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244a24-9f5d-46e2-808c-b800d75b6311 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244a24-9f5d-46e2-808c-b800d75b6311 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.690881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0244a24-9f5d-46e2-808c-b800d75b6311 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.692525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 357/739] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:54.693560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244a24-9f5d-46e2-808c-b800d75b6311 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.765575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.780423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ab590-e15f-44bd-91b3-0ccfedc81b55 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.807786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0244a24-9f5d-46e2-808c-b800d75b6311 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.815839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.816472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.816754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.817152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.817810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:54.818111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.820205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:54.833963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 383/740] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:54.833963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.847239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.847847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.848431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.848431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.849052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:54.849353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.850760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574004-61b4-40c6-b60f-12e125f18d73 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:54.863555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 358/741] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:54.863555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.863555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.863555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.880831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:54.882557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:54.885880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:54.952497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af53596-e315-4033-83b8-91e8b0e3e18a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:54.955608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 359/742] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:43:54.955990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:54.993227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:54.993865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:54.994146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:54.994422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:54.995118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:54.995427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:54.996869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.010422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 384/743] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:55.011314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.024242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.067119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aff3fc-b134-4476-9516-bfe207527057 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.103862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.104580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.104863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.105137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.114002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.118650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9958c84-22e6-4fb6-91c8-3990def72aa1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.118908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.120674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:55.136936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:55.138076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:55.139024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:55.139024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:55.139024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:55.141005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 360/744] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:55.141979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.162055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.163528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.163820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.164111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.178017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.180112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:55.199650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:55.200809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:55.201737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:55.201737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:55.201737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:55.203507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 385/745] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:55.208406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.271202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a708a52-0dac-43e3-8ec3-63bfd2996b26 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.280165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.314719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.315357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.315634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.315905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.324446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.326372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.330554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1553daa6-d12f-4069-bab7-450d237a7ff1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:55.338814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:55.339994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:55.341159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:55.346248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 361/746] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:55.346248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.377355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.378012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.378209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.381376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.381376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:55.381376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.382155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.400035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 386/747] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:55.400035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.420025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.475754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357ea0e-d503-4000-8656-93690943c197 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.510415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9bd046-79d8-4a53-93ee-91e8015190a4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.511388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.512291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.512607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.512869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.513521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:55.513820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.515194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.532493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 362/748] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:55.532493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.541096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.553798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.554848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.555403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.555728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.556383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.557789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.573783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 387/749] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:43:55 2022] POST /identity/v3/services => generated 240 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:43:55.574717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.652156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e747f-9b6a-4336-ab21-2419c926622c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.670125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.705854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.706945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.707477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.707942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.708976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:55.710115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.711895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.728028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 363/750] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:55.729286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.742171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf796c5-43d5-4cc6-892a-e08d72039cea None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.790124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.790780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.791064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.791342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.799381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.800890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:55.814975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:55.816259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 388/751] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:55.817346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.865070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c46b6e-f614-47b3-8f43-2add0425a977 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.873133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.904080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.904666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.904953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.905230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.914812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:55.916422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-fce8f62b-660c-43fd-9a75-2c747b6ba00b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:43:55.933340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:55.934340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:55.935285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 364/752] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:55.935890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f5fd-5f29-44e9-8f7e-28a327d88dec None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.936485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f5fd-5f29-44e9-8f7e-28a327d88dec None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.936485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a98f5fd-5f29-44e9-8f7e-28a327d88dec None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.937706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 365/753] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:55.941520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f5fd-5f29-44e9-8f7e-28a327d88dec None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:55.957869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4fcf0-5b44-48bd-a0b9-9191fa89812d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:55.976160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:55.997800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:55.998466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:55.998744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:55.999011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:55.999797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=187876bda81c4d66a857ba9d8c4affaf) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:56.000221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.001876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.016597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 389/754] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/role_assignments?user.id=187876bda81c4d66a857ba9d8c4affaf&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:56.016597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.076196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a98f5fd-5f29-44e9-8f7e-28a327d88dec None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.126478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.127137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.127577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.127976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.128773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:56.129348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.132214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824711-195b-4f14-92e2-91b40b4b9d2f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.146332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407595d-0469-4c99-9e63-f28f54153808 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.156089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 366/755] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:43:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:56.157536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.159108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.159797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.161070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.182707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:56.183914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:56.190593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.191532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.192011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.192465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.193348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:56.194426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.196278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.217514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 390/756] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:56.218696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.257252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 367/757] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:43:56.257810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.276260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.330753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19aa4e-11d6-454b-8504-e24fa9aca9c3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.363015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff04b32-417a-4742-91fb-c6c30373bdcf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.377275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.378269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.378906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.379393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.401227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.402226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.402605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.402982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.404516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.406283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:56.433481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:56.434667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:56.435774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:56.435774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:56.435774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:56.442078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 391/758] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:56.446709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.470720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.497628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.499481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.527126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.622793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8892c5-0458-4729-ac05-7dd9ed84b584 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.675996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.676228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 368/759] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:43:56.677135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.677248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.677718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.678781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.679674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:56.680315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.682129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.696062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 392/760] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:56.697384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.780770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210baeb-0c1d-46ca-8d52-7f69929f3e00 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.789566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.799091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:56.819325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.819962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.820308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.820615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.821199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.822500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365d9b4-f4fe-46c6-a12f-2891266a4068 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:56.822939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:56.831495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:56.832523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:43:56.833390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:56.836641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 369/761] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:56.837485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.866800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:56.868471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:56.869540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:56.870510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:56.885187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:56.887646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:56.906696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:56.907660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:56.908605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:56.908605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:56.908605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:56.908605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 393/762] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:56.908846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:56.966894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b1ab3-3719-47ae-b5e8-6e475e5732a6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.004880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.005663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.006040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.006504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.013837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.015384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.025526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3783f1-38f7-4a44-aa96-6c4a485960b7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:57.027958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:57.029078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:57.030209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:57.032324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 370/763] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:57.032731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.066960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.078930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.079951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.080383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.081273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.082076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.082548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.082927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.086843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.093483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 394/764] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:43:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.094819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.164427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b1b2-a2f0-4ce4-a83b-613678abb399 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.210688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.211312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.211590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.211863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.212564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.212869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.214917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.217044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9349f0-56f8-4a99-9737-39acc4324172 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.234201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 371/765] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.234201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.264059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.264700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.264982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.265257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.266365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.266671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.268421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.288475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 395/766] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.289690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.350957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.364244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.368217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf73d32-178e-45f5-9e7a-5a05a5ad9978 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.414032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.414898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.415258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.415629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.416356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.416798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.418349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.423398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee652236-8278-404b-9e08-c8d5f80c69c4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.423923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 372/767] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.424839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.471467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.472412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.472859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.473782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.484714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.486631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:43:57.505422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:57.507054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:43:57.508072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:43:57.517060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 396/768] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:57.518301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.547635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0d45-7d40-466f-8575-87d2d44b3d1c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.592598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.593618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.594038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.594476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.597326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=02cff3a52a8e47feb0acc62f084f110a, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.599192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.621523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 373/769] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:43:57 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:43:57.621523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.670864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.706233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037e64b8-2764-43d1-98b4-8a994b50a211 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.727069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:57.764600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.765334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.765632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.765949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.767012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] RBAC: Adding query filter params (interface=public, service_id=14acb60a1ced43b9b5c5aa9b6957ddd9, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.767333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.769771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156fd6e-1118-4637-9211-5ff9cceea588 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.783318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 397/770] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/endpoints?service_id=14acb60a1ced43b9b5c5aa9b6957ddd9&interface=public®ion_id=RegionOne => generated 194 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.785010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d29e1-8b5b-43cd-990b-e5db6bef0d2d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.785332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d29e1-8b5b-43cd-990b-e5db6bef0d2d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.785966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d29e1-8b5b-43cd-990b-e5db6bef0d2d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.792491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 398/771] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:43:57.793730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d29e1-8b5b-43cd-990b-e5db6bef0d2d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.798443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29ddac-b550-49dc-90ba-ba688925ed33 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.842716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.843719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.844066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.844497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.845237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:57.845609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:57.847149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387074f-1896-47c5-b345-e7a76d131cb6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:57.861490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 374/772] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:57.863219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.868890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.869287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.888462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:57.889994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:57.933758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d29e1-8b5b-43cd-990b-e5db6bef0d2d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:57.976416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 375/773] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:43:57.976416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:57.995938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:57.996510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:57.996852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:57.997128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:57.997742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:58.000051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43acc6f8-3fb8-438f-bffc-a9b47aac939c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:58.004189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:58.015189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 399/774] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/services => generated 772 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:58.106101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf628fe-7bea-4223-9bc4-dc16334397ce None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.106430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf628fe-7bea-4223-9bc4-dc16334397ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.106660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf628fe-7bea-4223-9bc4-dc16334397ce None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.108331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 400/775] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:43:58.118920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.119236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.119469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.153062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:43:58.154347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:43:58.165145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d1a18-3ece-490e-9a88-0ebb464cbd68 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:58.228723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:58.242433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:58.243316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.243745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.244184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.245097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=e0de8775c6564365b4a7c3268392b258) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:58.245576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:58.247232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:58.253680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 376/776] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:43:57 2022] GET /identity/v3/role_assignments?user.id=e0de8775c6564365b4a7c3268392b258&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:58.288626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 401/777] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:43:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:43:58.351649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.486515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:58.515463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbc672c-940d-41a3-8ccf-2572da9bbf71 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:58.558079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:58.559108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.559584 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.560029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.561020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:58.562571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:58.573102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:58.574142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:58.574981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 377/778] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/services/network => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:58.581797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.658863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.698100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da799d2d-f4e7-4843-8a7f-881186ee5ba4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:58.738294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:58.738910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.739247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.739616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.740976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] RBAC: Adding query filter params (name=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:58.741287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:58.742944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:58.753364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 402/779] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:58.754676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.793176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:58.839630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd653b-ed42-44d5-a3fa-308b4ae7d9f7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:58.868996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5238dd-4977-4aa3-aa69-6b1406ee2177 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:58.902145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:58.902800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.903077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.903347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.907333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:58.907947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:58.908227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:58.908541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:58.909177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:58.909479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:58.911068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:58.921618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 403/780] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:58.922986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.925787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:43:58.943270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:58.944315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:58.946059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 378/781] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:43:58.953657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:58.958889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:59.030626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:59.035822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4915773-5388-430c-8038-73d9cde64b9f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.075189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:59.075727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:59.076014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:59.076346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:59.077192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] RBAC: Adding query filter params (interface=public, service_id=51f7959504434ad2818ab5ac97a47635, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:59.077508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:59.079273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:59.089963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 404/782] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/endpoints?service_id=51f7959504434ad2818ab5ac97a47635&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:59.091328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:59.101116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe26403-a11d-4dee-be92-6824884fa175 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.193104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:59.193762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:59.194042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:59.194320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:59.195110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:59.195429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:59.196857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:59.202047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc9a2d-3e08-4038-8e77-36c34f79fed0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.212915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 379/783] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:43:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:43:59.218418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:59.239135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:59.239749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:59.240083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:59.240363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:59.241027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:59.242766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:59.252595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 405/784] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:43:59 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:59.348946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:59.420123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed90348-2cfe-4dce-8e9d-e23ee0d32561 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.463755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:59.464793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:59.465303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:59.465774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:59.478325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:59.480189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:43:59.497129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:43:59.498194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:43:59.499098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:43:59.499098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:43:59.499098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:43:59.501276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 380/785] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:43:59.507134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:59.536759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:43:59.614175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa4ca72-7c6e-4868-ace0-ac725826cc5f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.652297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:43:59.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:43:59.653225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:43:59.653502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:43:59.654146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:43:59.654449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:43:59.655842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:43:59.669776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 406/786] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:43:59.677771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:43:59.965527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e0005d-ada8-4592-9dba-9fff68d892e9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:43:59.991776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:00.026188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:00.026845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.027127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.027399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.035649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:00.037128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3375344f-4d24-4726-9b9a-4058e2799fe3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:00.048847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:00.049828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:00.051516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 381/787] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:43:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:00.056514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:00.097117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc921-1999-46ab-a5c0-b04446d388dc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.097441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc921-1999-46ab-a5c0-b04446d388dc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.097681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cc921-1999-46ab-a5c0-b04446d388dc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.098995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 382/788] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:00.105043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.105626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.105626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.124804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:00.126129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:00.230676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 383/789] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:00.262061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:00.310542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4f555-5a90-4939-823b-19c543378e73 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:00.416417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:00.416417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.416417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.416417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.417315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:00.417634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:00.419094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814c7529-c3e5-4f91-8081-32a066c30f96 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:00.450258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 407/790] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:44:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:00.457740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:00.604525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef75-e195-4b9d-9c27-245f67b8e6cc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.604525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef75-e195-4b9d-9c27-245f67b8e6cc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.604525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef75-e195-4b9d-9c27-245f67b8e6cc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.605855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 408/791] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:00.623981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.624263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.624787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.647484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:00.649021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:00.655830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481983c8-df61-4f0f-a72c-3a6733ad7785 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:00.665656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:00.700748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:00.701795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.702651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.702933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.717473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:00.719630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:00.730402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 409/792] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:00.731321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:00.736683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:00.738144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:00.739510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:00.739510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:00.739510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:00.742462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 384/793] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:00.752854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:00.882211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:00.914439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3134c92-7040-4668-b2f0-118f56c5a8d7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:00.922426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a42a6b-c555-4585-a9d8-df6b7922fccd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:00.950538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:00.951215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:00.951497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:00.951824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:00.962319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:00.967104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:00.968247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:00.969355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:00.971948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 410/794] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:00.977474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.012179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.013028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.013313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.013587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.014244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.014546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.015929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.031095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 385/795] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.032056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.051190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.102181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3c555-794f-492f-b6bf-80e2163617bd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.137790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6432b85-373b-4263-9b71-32fb6efa87cf None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.138912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.139700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.140076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.140505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.141231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.141616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.143055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.148755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.156742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 411/796] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.161145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.177025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.177667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.178501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.178781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.179457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.180749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:01.190380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:01.191400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:44:01.192266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:01.197951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 386/797] 10.222.0.64 () {56 vars in 1129 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:01.198898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.283960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323ef3-3321-4f6d-b0bc-ccac747ae2c9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.291593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.313619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2fb936-19a3-42ae-997c-a7b69cb9bb80 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.321755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.322455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.322802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.323142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.329884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.331394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8828b4c1-4b24-435b-af63-bbb0d323128f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:01.351096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:01.352041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:01.353044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 412/798] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:01.353536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27f6f-75d7-4b7a-a331-11cd2aa93f8e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.354158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27f6f-75d7-4b7a-a331-11cd2aa93f8e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.354158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b27f6f-75d7-4b7a-a331-11cd2aa93f8e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.355352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 413/799] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:01.357629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.358295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.358561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.358836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.359956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27f6f-75d7-4b7a-a331-11cd2aa93f8e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.371490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.373070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:01.390561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:01.391537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:01.392470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:01.392470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:01.392470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:01.392470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 387/800] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:01.392713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.432074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.478977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b27f6f-75d7-4b7a-a331-11cd2aa93f8e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.504619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a985882-9a4f-46ee-8198-d24646ae3fda None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.515253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.515943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.516142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.516440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.517110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.517369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.518756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a98e6-8ba5-4346-bbe5-bb1108bc028d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.523932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 414/801] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.524984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.525269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.525545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.543286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:01.544613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:01.546942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.548274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.548583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.548851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.549531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.549832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.551245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.554029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.576158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 388/802] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.576158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.616788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 415/803] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:01.621641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.683400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.689787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1577be3-2fed-40f7-9f1a-5171e1584592 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.731675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.732991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.733687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.734112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.734910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.735583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.737878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.747741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2eada0-cef0-4c60-ab04-9872aeb7fec3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.753726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 389/804] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.754787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.787731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.788345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.789076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.789076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.789578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:01.789881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.791239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.797484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 416/805] 10.222.0.64 () {56 vars in 1124 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:01.798506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.827060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.876303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b006ac-e464-4bde-a580-d0f6e0fa1684 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.904989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e474707-640b-46fc-8b1b-59cc3681adca None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:01.910809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.911463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.911737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.912005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/187876bda81c4d66a857ba9d8c4affaf/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.914484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=187876bda81c4d66a857ba9d8c4affaf, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.915905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e3d9bb-b7df-4ce3-adad-a8796fa8a120 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.919771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:01.929332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 390/806] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:01 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/187876bda81c4d66a857ba9d8c4affaf/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:01.930878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc929-ad0f-4632-ab17-b05c3a629523 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.931164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc929-ad0f-4632-ab17-b05c3a629523 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.931435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cc929-ad0f-4632-ab17-b05c3a629523 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.932877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 391/807] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:01.937946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cc929-ad0f-4632-ab17-b05c3a629523 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:01.945594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:01.946369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:01.946648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:01.946919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:01.955660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:01.957158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:01.970401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:01.971403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 417/808] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:01.972338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.078546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cc929-ad0f-4632-ab17-b05c3a629523 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.093336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69451e4c-4dc0-402f-8fd2-a0728aff29f4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.095045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.119315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.120015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.120365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.120816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.121447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.122885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a732540-3cab-47d1-b57f-17f9a868f1e1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.130825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.131483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.131758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.132027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.146341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:02.147208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 392/809] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:02.148381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.148704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.148980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:02.151618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:02.152745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:44:02.153660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:02.158057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 418/810] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:44:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:02.159121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.181718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:02.183832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:02.201212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.284574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac7446-0214-471d-8a7b-e65d76bfd48c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.299810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 393/811] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:02.300283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.324706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.325707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.326182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.326661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.327578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:02.328076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.329804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.353453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 419/812] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:02.362988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.414913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.427260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fef16e-910d-4268-bd64-7b83fba0f2b4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.472269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.472971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.473152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.473405 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.474057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:02.474360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.476330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.486833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 394/813] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:02.493511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.513066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.526358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2078c-e2d3-4fe7-a227-93e22e8ebc89 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.564222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.565111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.565579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.565994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.640741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.642729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.677398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd6c6a5-4ad8-4086-aa7a-4c1344d257ba None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.722396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.723301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.723586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.723867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.739257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.741057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.748744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.756669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 420/814] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:02.757846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:02.760138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:02.761134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:02.762047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:02.762047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:02.762047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:02.764466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 395/815] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:02.765487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.783700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:02.875149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59803bc3-b953-4abc-8b84-57f2101de127 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.893809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38db1f-9f7a-426a-aaf1-acced7ff5db8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:02.910712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.911720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.912746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.913240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] PATH_INFO: `/v3/services/network` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.914030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.915610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:02.924859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:02.925875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:44:02.926725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:02.929901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 421/816] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:02.930942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:02.935871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:02.936997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:02.936997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:02.937172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:02.949745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:02.951202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:02.966631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:02.967624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:02.968541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:02.968541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:02.968541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:02.968541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 396/817] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:02.969260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.013405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.040042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.071225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2acbc09-1ff8-48b0-b743-57774b5a9d19 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.098892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e10163-90b1-4a71-83e6-982743067a81 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.109468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.110191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.110630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.111022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.111769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.112194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.113780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.131193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 422/818] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.131193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.147128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.147783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.148472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.148574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.149310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.151111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.160615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 397/819] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.160615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.273444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67269d34-33a7-414f-a24d-59d5db101db6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.281293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e3d81-8732-437e-b9d3-216c37e4c7da None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.299945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.308677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.320023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.321818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.321818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.321818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.328956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.329790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.330493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.330910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.331241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.331856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.332312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.333080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.334763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:03.350536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:03.351556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:03.352643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:03.353176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 423/820] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.353176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.354597 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 398/821] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:03.357309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.487361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d09ac4b-6e9e-469e-9ae8-3770f6b6a831 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.494238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ff4c-7778-4a51-8e38-2fe73201d436 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.525445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.526263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.526483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.526810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.534165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.535765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.540513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.541391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.541897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.542391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.543221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] RBAC: Adding query filter params (type=network) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.544000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.545592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:03.549406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:03.550283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:03.551190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 399/822] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:03.552101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.554239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 424/823] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.556985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.608430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.675640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b729f467-3ff3-4059-b6bb-527a3f9b72ac None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.718972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.719720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.720070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.720426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.721205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.721582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.723558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.741205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 425/824] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.742626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.746285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.791167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c38aa-bbb1-4640-a8ef-7738ebe10ff1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.829704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.830675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.831229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.831706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.832682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:03.833234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.835025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.853797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:03.856089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 400/825] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:03.857408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.862004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13550c0c-8f90-4a0b-856a-4b881b4e9678 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.898925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:03.899543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:03.899922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:03.900208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:03.900904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:03.902288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:03.925787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 426/826] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:03.926782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:03.975469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7ed0-22a7-4b51-b8a0-a49d1d670a45 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:03.979628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.041475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.042031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.042311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.042580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.043318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:04.043624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.045109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef280d-6a13-46ea-9f90-d00d238ff771 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.056556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 401/827] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:04.058301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd72c-0f20-4ce1-b540-1c2e600c39bd None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.058853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd72c-0f20-4ce1-b540-1c2e600c39bd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.059335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dbd72c-0f20-4ce1-b540-1c2e600c39bd None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.062985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 402/828] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:04.068026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4780a-7387-4939-bc51-3c3f2b22eadb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.076307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.076675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.076885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.098076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:04.100026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:04.130521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.131213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.131758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.131758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.144983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.146584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:04.163714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:04.164733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:04.166099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:04.166099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:04.166099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:04.166099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 427/829] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:04.171071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.183321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 403/830] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:04.186605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.289640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aef840-817c-46aa-9c1e-24d0f6b990fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.327339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.327883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.328163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.328531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.329189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:04.329490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.330861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e278425-31c8-4ee1-9840-c66d1bc084e3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.345230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 428/831] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:04.350971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.366836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68810-5864-4e72-b10c-eb27b88ae672 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.367145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68810-5864-4e72-b10c-eb27b88ae672 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.367392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f68810-5864-4e72-b10c-eb27b88ae672 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.369228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 429/832] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:04.374790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.375075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.375350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.401818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:04.403034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:04.473711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.480939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 430/833] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:04 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:04.481694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.495143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.500409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74bdbf-6a61-4ae0-881c-ac2cabf01177 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.537545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.538343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.538721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.539114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.546413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.548023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:04.561198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:04.562120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:04.562563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 404/834] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:04.567776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.595407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f9d70e-8b9c-4019-9245-118651066f77 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.632351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.633026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.633311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.633582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.647464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:04.654176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:04.655533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:04.656943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:04.658899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 431/835] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:04.665923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.679906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2136fdf-8104-44e0-806e-09f93a198300 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.717873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.718475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.718749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.719013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.719689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:04.719985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.721426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.740654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 405/836] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:04.743929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.760514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.763450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:04.806754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e75a5c-a2ff-4700-a1b2-d527c158dbfd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.845332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.846001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.846229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.846501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.847163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:04.847469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.849011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.858290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 432/837] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:04.858462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25b59d-cf7f-47ae-85f5-af588e482c3c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:04.859486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.897421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:04.898387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:04.898765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:04.899040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/e0de8775c6564365b4a7c3268392b258/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:04.914306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=e0de8775c6564365b4a7c3268392b258, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:04.915731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:04.940425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 406/838] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:04 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/e0de8775c6564365b4a7c3268392b258/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:04.940425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:04.992430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982340f-faeb-4903-b085-a003e5862d15 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.019484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.023708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.044406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.045163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.045745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.046085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.047255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.049478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:05.061331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:05.062420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:05.063260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:05.067984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 433/839] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:05.070713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.080332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc51d87-1b2f-4aac-bbd1-175b7ce1e4da None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.129020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.129587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.129865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.130136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.141387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.142845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:05.157186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:05.158412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:05.159507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:05.159507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:05.159507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:05.159507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 407/840] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:05.166324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.213955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df690-da3f-44ce-9257-f89644064954 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.254159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.254726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.255078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.255426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.256222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:05.256630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.258097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.268415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 434/841] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:05.269450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.303954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18514b1b-939a-4b6d-a2a1-a524f7de126c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.331996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.360938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.365871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.367704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.368461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.369002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.370527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:05.371038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.373564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.397361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 408/842] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:05.398573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.430818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb429c6b-befa-4687-aea6-273e6979a51c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.468267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.469043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.469420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.469790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.470546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:05.470944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.472473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.484419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 435/843] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:05.531989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e3a52d-91b1-404a-94de-403e70a2c30c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.571155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.571798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.572076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.572346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.580712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.582235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:05.595645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:05.596704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:05.597651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 409/844] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:05.605600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.716283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bcb50-12fd-4f2c-811d-342865b476f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.730674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.754043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.755249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.755800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.756291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:05.757246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:05.757776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:05.759402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:05.778834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 436/845] 10.222.0.64 () {56 vars in 1135 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:05.784774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:05.823536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:05.894572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237e5fd2-d32b-4622-8a8c-00a9b643dda7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:05.930633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:05.931244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:05.931520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:05.931786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.005426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.007539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd11794-8ae5-449a-a62c-9e80a34d5de1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.043520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:06.115609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 410/846] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:05 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:06.121537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.202022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0afecd-1e19-481d-b6ce-f732bf6e84aa None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.202381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0afecd-1e19-481d-b6ce-f732bf6e84aa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.202758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0afecd-1e19-481d-b6ce-f732bf6e84aa None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.205083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 411/847] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:06.211588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.212213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.212719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.231583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa0ace-f82b-443e-881c-ee5a8e0999e1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:06.232111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:06.233689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:06.266882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:06.267438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.267775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.267989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.279427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.280960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:06.295921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:06.296926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:06.298215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:06.298215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:06.298215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:06.298215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 437/848] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:06.302976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.316102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 412/849] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:06.335373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:06.420520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52cce6a-848a-4919-ab0a-fbec525a75ed None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:06.455947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:06.456923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.457424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.457920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.458861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:06.459372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.461501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.474998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 438/850] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:06.481345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.553386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:06.595108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d6bb9-3833-43ca-b69e-a92e8f721643 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:06.621433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.635807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:06.636809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.637483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.638351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.647499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.650560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:06.666770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:06.667830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:06.668776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 413/851] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:06.675710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.796626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad764a-fb03-4055-8d74-338e0580d615 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:06.823904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:06.826127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:06.836920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:06.837528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.837808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.838076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.838760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:06.839055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.840750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.846956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c279eb1-39a4-4c0f-91be-7e02379c6871 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:06.854100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 414/852] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:06.860503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.886086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:06.886738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:06.887019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:06.887296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:06.887882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:06.889354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:06.898915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:06.899888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:06.900825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 439/853] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:06.909310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:06.980456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b70dc7-218b-471a-9aef-7964a90bf432 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.014536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.015139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.015418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.015690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.016421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=187876bda81c4d66a857ba9d8c4affaf) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:07.016732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:07.018148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6629bc8-5584-4a09-841c-5d819ffcce10 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:07.020112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e01280f-e836-49d0-aeeb-59e0fc34fea5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.036568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 415/854] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/role_assignments?user.id=187876bda81c4d66a857ba9d8c4affaf&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:07.036568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d5d-8e41-49dc-88ca-825b066c5be9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.036568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d5d-8e41-49dc-88ca-825b066c5be9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.036568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e3d5d-8e41-49dc-88ca-825b066c5be9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.036568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 416/855] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:07.039622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.040146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.040640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.060602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:07.062122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:07.070262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.070880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.071159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.071432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.072074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:07.072377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:07.074505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:07.084437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 440/856] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:07.087950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:07.104968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:07.125377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:07.156820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 417/857] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:07.205106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7c6da-3c8d-47e9-9db5-fa0217ebfef7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.242181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.242934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.243135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.243406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.244093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:07.244424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:07.245797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ce53a7-05d9-42e3-9d06-05feb7a8a20c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:07.251128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 441/858] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:07.445144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:07.549370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29645430-1377-46eb-9078-8294be3cb3ee None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.559413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47617-f1b4-4388-b0a5-973ee917934d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.559728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47617-f1b4-4388-b0a5-973ee917934d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.559964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b47617-f1b4-4388-b0a5-973ee917934d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.561665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 442/859] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:07.566886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.567172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.567447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.586194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.586826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.587100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.587371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.588314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:07.589680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:07.598166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:07.602919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:07.603866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:07.604774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 418/860] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:07.610585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:07.670003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:07.682909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 443/861] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:07 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:07.738687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab19799-061b-4e6c-b4d1-132330a07f72 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.775902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.776857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.777333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.777762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.778558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:07.779000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:07.780572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:07.789599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 419/862] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:07.797477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:07.801141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:07.909242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0cbe0c-bf9f-4506-ad82-0340bc35d072 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:07.947363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:07.948340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:07.948889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:07.949369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:07.958533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:07.961181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:07.963158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:07.980259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:07.981283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:07.982199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:07.982199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:07.982199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:07.984264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 444/863] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:07.990668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:08.056786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:08.066848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee9c13-9fd4-4aff-96b0-333803696691 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:08.068523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:08.100530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56f9af9-d3d1-4ba2-9f85-e4650f0329d9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:08.104101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:08.104566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:08.104846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:08.105121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:08.105765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:08.107137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:08.128484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 420/864] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:07 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:08.159193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:08.160156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:08.160836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:08.161294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:08.162707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:08.163246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:08.164957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:08.181703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 445/865] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:08.187282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:08.300414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c56c2-a006-4cd9-9f8e-3d8db1fd7616 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:08.339282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:08.339916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:08.340195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:08.340499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:08.348048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:08.350078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:08.361423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:08.362404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:08.363691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 421/866] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:44:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:08.368524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:08.483837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651cbbbd-8a86-4add-8f69-aea2aee86efb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:08.497945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:08.528303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:08.529678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:08.530360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:08.531067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:08.532602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:08.533332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:08.535249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:08.554362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 446/867] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:44:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:08.564534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:08.590638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:08.672916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab3e4c-d857-47ef-9633-bd6c26b7d5be None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:08.708658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:08.710059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:08.710521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:08.710944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:08.785455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:08.787247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50de90-0a12-47c1-8163-ebc058f30dd9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:08.811683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:08.891826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 422/868] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:08 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:08.897980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.002353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309dab8-58bc-4b7d-9330-f26b996f165c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.025056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3159e-6f08-4961-a94d-59919b9f7ccf None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.025342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3159e-6f08-4961-a94d-59919b9f7ccf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.025729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3159e-6f08-4961-a94d-59919b9f7ccf None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.027426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 423/869] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:09.032612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.032897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.033174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.039106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.039907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.041037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.041320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.051444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:09.053193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:09.053442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.054899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:09.070914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:09.072065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:09.073155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:09.073155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:09.073155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:09.073155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 447/870] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:09.079056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.110316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.137417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 424/871] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:09.201088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94a903-d69e-4df8-b595-95bfcf88b55e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.237604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.238496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.238924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.239343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.240694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:09.241418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.242934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd4f03-93ee-4699-be98-fde8990cebbc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.256180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 448/872] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:09.262033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.268193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adc9c-8bd6-4feb-ab21-946fa1ae9293 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.268517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adc9c-8bd6-4feb-ab21-946fa1ae9293 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.268798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618adc9c-8bd6-4feb-ab21-946fa1ae9293 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.270360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 449/873] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:09.275578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.275863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.276128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.295354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:09.296579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:09.328039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.408643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 450/874] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:09 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:09.410378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.418672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01546a63-31b8-49b8-8605-f8f23bca6d40 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.427042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.467411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.468455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.468744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.469019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.477249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.479386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:09.496813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:09.497837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:09.498730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:09.500614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 425/875] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:09.504430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.541700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdbbe7-75f8-4b31-8486-a4ccf9edf469 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.584322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.584911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.585192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.585464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.586159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.587716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:09.597113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:09.599069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:09.600924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 451/876] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:09.604855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.629289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3975ea5-4a17-4525-9def-98d5adc83c2c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.642732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.666066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.666677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.666952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.667223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.668250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:09.668250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.669660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.682837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 426/877] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:09.688382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.714750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.747805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f46cb-c45d-4477-a792-db8218d0ef59 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.791223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.791679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.791955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.792228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.793002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:09.793291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.794818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.800162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 452/878] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:09.800800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.817211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53196304-fdd8-4dfe-ae96-05c3eb36fdee None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.855226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.855746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.856029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.856300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.857059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=e0de8775c6564365b4a7c3268392b258) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:09.857364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.858794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.864767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 427/879] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/role_assignments?user.id=e0de8775c6564365b4a7c3268392b258&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:09.865588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:09.918567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:09.934795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4198e55-4341-458e-8c3d-078e6ace2c21 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:09.974138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:09.975334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:09.975614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:09.975888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:09.976640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:09.978467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4aee8c-0682-4ea0-8f7b-8d844f5365c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:09.990573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:10.004635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 453/880] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:09 2022] POST /identity/v3/services => generated 269 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:10.029131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1264c5d-3bc2-4e03-9926-c1eb200137fe None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:10.078863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:10.079855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:10.080324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:10.080831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:10.081708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:10.082270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:10.084572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cc73c-1098-4b86-96ee-08d96720368e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:10.090812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 428/881] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:10.306986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58218-53fe-46e2-a145-1896a993bcb8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:10.307324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58218-53fe-46e2-a145-1896a993bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:10.307552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c58218-53fe-46e2-a145-1896a993bcb8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:10.309229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 454/882] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:10.317018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:10.317309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:10.317591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:10.338236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:10.339450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:10.415901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 429/883] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:10 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:10.688265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c58218-53fe-46e2-a145-1896a993bcb8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:10.801560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c58218-53fe-46e2-a145-1896a993bcb8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:10.840459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:10.841094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:10.841372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:10.841637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:10.842215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:10.843573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:10.852163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:10.853186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:10.854057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 455/884] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:10.859765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:10.888824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:10.968800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba1f35-4d97-4c03-a266-7b0bd4379c6c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:11.006792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:11.007663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:11.008117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:11.008568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:11.009359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:11.009807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:11.011346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:11.017158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 430/885] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:11.023136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:11.094465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:11.138149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb06b2-b8a2-4dbd-814d-c3e6e38735e4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:11.174611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:11.175577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:11.176008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:11.176469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:11.177330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:11.178285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:11.179932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:11.186406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 456/886] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:11.192731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:11.303677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:11.313163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eed758-3f35-4dc5-9b59-e1127e631df7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:11.350924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:11.351529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:11.351802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:11.352068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:11.352794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] RBAC: Adding query filter params (interface=public, service_id=393d02ff228843cabdaed53d6b5245fc, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:11.353095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:11.354453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cd2f9-244c-4f39-82d9-a5d86975fa34 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:11.362146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 431/887] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:44:11 2022] GET /identity/v3/endpoints?service_id=393d02ff228843cabdaed53d6b5245fc&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:11.367899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:11.479312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8e3cf-4407-42c0-9389-fc558a118902 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:11.508884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:11.519096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:11.519746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:11.520028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:11.520302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:11.521625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:11.523110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee35e4-a680-4a62-8d78-13bf1dc341d1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:11.533996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 457/888] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:11 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:44:12.021989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff917-4506-489d-b9bf-00a18e6ce59a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.022515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff917-4506-489d-b9bf-00a18e6ce59a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.022515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182ff917-4506-489d-b9bf-00a18e6ce59a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.024139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 432/889] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:12.030010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6935d-3471-4bab-8559-b71834f8ee34 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.030462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6935d-3471-4bab-8559-b71834f8ee34 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.030543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6935d-3471-4bab-8559-b71834f8ee34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.049305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-27b6935d-3471-4bab-8559-b71834f8ee34 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:12.050514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-27b6935d-3471-4bab-8559-b71834f8ee34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:12.080959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877ddd-8d85-4ed2-acd4-0b412c293a86 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.081267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877ddd-8d85-4ed2-acd4-0b412c293a86 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.081513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b877ddd-8d85-4ed2-acd4-0b412c293a86 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.083160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 433/890] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:12.092916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.093276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.093621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.117750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:12.119042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:12.148105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 458/891] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:12.148105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f40f-221a-456e-9aba-eb641c5bbfa9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.148105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f40f-221a-456e-9aba-eb641c5bbfa9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.148105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce8f40f-221a-456e-9aba-eb641c5bbfa9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.148744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 459/892] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:12.154101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.154470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.154749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.176774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:12.178901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:12.203727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 434/893] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:12.259098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 460/894] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:12.438355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.502733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.533590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:12.557764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d3755-a161-4794-97d7-976c9351578e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:12.568202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:12.601968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:12.602646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.602929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.603205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.615332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:12.620520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:12.621652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:12.622682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:12.623430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0aebe-0800-486a-95fc-e118fc8997f3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:12.625099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 435/895] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:12.626008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.676782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:12.678037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.678683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.678961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.679536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:12.681239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:12.689895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:12.690830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:12.691748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 461/896] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Aug 25 02:44:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:12.693229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.759003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c416a2-6bdb-44cf-bd4d-52c9b9d7e805 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:12.798065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:12.798679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.798956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.799229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.799869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:12.801272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:12.817691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 436/897] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:12 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:12.818735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.823641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:12.832177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e458e39-7ad9-4ee0-8da8-222d2ccb8d08 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:12.862899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:12.898415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:12.899046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:12.899575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:12.899850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:12.901987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:12.903163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:12.905881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:12.921309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 462/898] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:12.929736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:12.963568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89533c6a-91f6-4db0-8c91-428d00f927b2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.006916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.007549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.007835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.008106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.008799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:13.009099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.010472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.015726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 437/899] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:13.022750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.066019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914aaa30-8607-422e-8f26-3ee7d7087ed1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.104918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.120682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.121477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.122233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.122606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.138912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.141214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.146506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89edcc4-24f1-490a-aad3-d4e931d4a5da None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:13.162206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:13.163230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:13.169201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:13.169201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:13.169201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:13.169201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 463/900] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:13.170788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.192507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.193598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.193878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.194149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.195015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:13.195413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.197044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.203648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.211551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 438/901] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:13.214075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.295073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1da96-a6a8-4c9f-8d32-09b7ae854f43 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.332792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.334446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.334947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.335426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.336361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:13.336907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.340136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.349591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b3899-c875-408b-a7f8-0a9fb50c6c29 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.361158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 464/902] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:13.362870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.389891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.390644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.390925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.391034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.391742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] RBAC: Adding query filter params (interface=public, service_id=e32cfc97c18e4c33a493cc865eca4aea, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:13.392049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.393623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.403299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.407067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 439/903] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/endpoints?service_id=e32cfc97c18e4c33a493cc865eca4aea&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:13.407997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.487832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.507288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175b4b10-771e-42e2-a988-05221480a25e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.536417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac8491-46d0-45e0-86a9-453f8726350b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.547608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.548331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.548682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.548960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.559386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.560869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b5801e13-7bf9-4459-810b-9020f58e055f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:13.574028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:13.575052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:13.576022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 465/904] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:13.577435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276413-37a0-4de3-aa7e-9f2531d0ac78 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.577435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276413-37a0-4de3-aa7e-9f2531d0ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.577435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68276413-37a0-4de3-aa7e-9f2531d0ac78 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.578605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 466/905] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:13.583938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.584222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.584573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.585798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.586422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.586700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.586975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.587582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.588997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.595878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 440/906] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:44:13.596722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.613311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:13.615117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:13.686500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.733380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 467/907] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:13 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:13.748209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75596a54-4966-4bdd-b453-776c84a8afc5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.789027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.789651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.789933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.790209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:13.790947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:13.791253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:13.792724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:13.816602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 441/908] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:13.819382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:13.902982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:13.929412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3ef284-a6b1-4c1e-a988-2a09d7b72017 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:13.965945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:13.966577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:13.966858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:13.967131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.008852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.041362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.042833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.115340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede1d0-aba7-40ea-8404-67b32c2a09a7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.122788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.138548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.152848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 468/909] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:13 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:44:14.154093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.162770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.163410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.163687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.163957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.164829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.165930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:14.175568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:14.176610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:14.178640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 442/910] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:14.182939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.278567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0345a-15c5-4767-bafa-ac7ccd0023f3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.325487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c013-68db-4f58-870a-25489202e52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.326215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c013-68db-4f58-870a-25489202e52b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.326580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c013-68db-4f58-870a-25489202e52b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.326925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360c013-68db-4f58-870a-25489202e52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.328143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b85282-09bf-4b71-b324-f751ab221693 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.338652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360c013-68db-4f58-870a-25489202e52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.339935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360c013-68db-4f58-870a-25489202e52b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8360c013-68db-4f58-870a-25489202e52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:14.355717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:14.356881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:14.358277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:14.358277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:14.358277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:14.359541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 469/911] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:14.365149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c013-68db-4f58-870a-25489202e52b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.374023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.374802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.375214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.375756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.376294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:14.376734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.378261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.388184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 443/912] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:14.389134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.407628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.440235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.493626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360c013-68db-4f58-870a-25489202e52b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.497229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b2abc-00e5-43b3-b0aa-7aa161f30723 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.532339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.532903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.533566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.533818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.533923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.534169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.534595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.534801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:14.535104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.535455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.536302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:14.537054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.537547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.539336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.546897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 444/913] 10.222.0.64 () {56 vars in 1114 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:14.547877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.559421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 470/914] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:14.561138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.653248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d51dac-799a-4b77-a51d-fb89eefe4c2c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.659608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.666911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:14.676058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec6511-2f53-415a-bd8a-69f81a5b7b72 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.693780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.694435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.694724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.695040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.695694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.697248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.717074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.718096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.718582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.719104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.720470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 445/915] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:14.739431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.741776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-def11555-c212-4e31-a601-233eae71ea37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:14.756503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:14.757505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:14.758440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:14.765042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 471/916] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:14.767872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:14.812787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871187e7-773d-4ec1-b350-d228a835780a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.812988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871187e7-773d-4ec1-b350-d228a835780a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.813248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871187e7-773d-4ec1-b350-d228a835780a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.814933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 472/917] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:14.821174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.821465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.821714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.841002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:14.842276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:14.913234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e431f40-d510-46ca-b6a9-79fb58d6089a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:14.941639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 473/918] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:14.960447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:14.960447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:14.960447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:14.960447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:14.960865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:14.960865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:14.960865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:14.972194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 446/919] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:14.978275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:15.058453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:15.081076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380a0f1-d94d-43ce-aa87-33da43dd3051 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:15.116865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:15.117473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.117786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.118073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.118860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] RBAC: Adding query filter params (role.id=2b8df647ad294701ae3b6420f8f1fab8, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=e0de8775c6564365b4a7c3268392b258) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:15.119174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:15.120736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:15.127295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 474/920] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:14 2022] GET /identity/v3/role_assignments?user.id=e0de8775c6564365b4a7c3268392b258&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=2b8df647ad294701ae3b6420f8f1fab8 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:15.268239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:15.297755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:15.383058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20999d4a-cb19-4482-9b9a-a5386ece21a9 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:15.419255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:15.419890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.420221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.420527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.421108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:15.422472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:15.432178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:15.433238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:15.434109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:15.436505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 447/921] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:15.439711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:15.545502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cf0ae-8f45-454d-8e38-c2beb20b57bc None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:15.580666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:15.581663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.582149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.582648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.583526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:15.584047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:15.585644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e7aae1-702e-4aba-8e00-152fd88541c4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:15.591208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 475/922] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:15.598277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:15.638501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67547b-c5a5-47da-8dbb-cfc52ed1da4c None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.639116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67547b-c5a5-47da-8dbb-cfc52ed1da4c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.639593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67547b-c5a5-47da-8dbb-cfc52ed1da4c None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.641807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 476/923] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:15.648223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.648808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.649314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.669002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:15.670617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:15.693002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:15.697630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:15.711135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac483e7-aba1-4212-af35-41b4e26b4d8e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:15.750079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:15.750961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.751384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.751788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.752591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:15.752968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 477/924] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:15.753225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:15.754727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:15.760924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 448/925] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:15.772931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:15.875502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5afeb-0120-4614-9ca6-ae6022b5c331 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:15.910910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:15.912007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:15.912355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:15.912661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:15.913371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] RBAC: Adding query filter params (interface=public, service_id=4e91873739364cbe9ce08862f9ce2608, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:15.913680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:15.915052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:15.917604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:15.921099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 478/926] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:44:15 2022] GET /identity/v3/endpoints?service_id=4e91873739364cbe9ce08862f9ce2608&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:15.926813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:16.033623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:16.047167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077dc56c-0039-4c5d-8726-3892844ff60e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:16.095397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:16.096916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.097710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.098190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.099842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:16.101919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:16.116693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 449/927] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:15 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:44:16.175495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c394add-9c2b-49cd-9f08-ffcfc091fe70 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:16.221244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:16.222253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.222733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.223204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.224059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:16.225705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:16.235840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:16.236893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:44:16.237818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:16.246240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 479/928] 10.222.0.64 () {56 vars in 1132 bytes} [Thu Aug 25 02:44:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:16.249596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:16.272997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:16.365502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04552652-5109-4937-bf9b-1be6745e5935 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:16.411725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:16.412709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.413395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.413888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.414718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:16.415217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:16.417138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:16.427359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 450/929] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:16.429030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:16.497187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:16.538457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef26eecb-b975-43fa-9ed0-a54ee662baaa None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:16.575325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:16.576355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.576918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.577384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.578207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:16.578706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:16.580270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56edc84d-c5ff-482f-9ef7-bc15ec5403cf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:16.590003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 480/930] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:16.592283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:16.677565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:16.700678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aa6f4-ecd2-4c7b-874d-d4efabf9e737 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:16.736544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:16.737434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.737871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.738284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.739102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:16.741560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6110e8-d5d7-4296-93e1-42e88ebb3088 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:16.768497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 451/931] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:16.926326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2c5b-6d54-4dad-9c9a-b8d7966bf7a5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.926610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2c5b-6d54-4dad-9c9a-b8d7966bf7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.926940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2c5b-6d54-4dad-9c9a-b8d7966bf7a5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.929142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 481/932] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:16.934802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969709d9-bf40-4114-a1b6-138eaa97d40d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:16.935092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969709d9-bf40-4114-a1b6-138eaa97d40d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:16.935363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969709d9-bf40-4114-a1b6-138eaa97d40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:16.953511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-969709d9-bf40-4114-a1b6-138eaa97d40d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:16.954708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-969709d9-bf40-4114-a1b6-138eaa97d40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:17.031171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 452/933] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:17.140150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723373-106c-43db-8ba4-6cfc4fe44c75 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.140479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723373-106c-43db-8ba4-6cfc4fe44c75 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.140715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5723373-106c-43db-8ba4-6cfc4fe44c75 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.142297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 482/934] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:17.149756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280730-e857-46db-babc-b106dc213f75 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.150169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280730-e857-46db-babc-b106dc213f75 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.150538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280730-e857-46db-babc-b106dc213f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.169778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d6280730-e857-46db-babc-b106dc213f75 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:17.170974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d6280730-e857-46db-babc-b106dc213f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:17.230529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:17.243880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 453/935] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:17.323997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723373-106c-43db-8ba4-6cfc4fe44c75 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.443888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5723373-106c-43db-8ba4-6cfc4fe44c75 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:17.472019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:17.482681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:17.483602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.484102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.484613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.485475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:17.487389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:17.490356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING keystone.server.flask.common [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 02:44:17.511658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:44:17.511658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 02:44:17.511658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [parameters: {'id': 'a9095cbb9cff40099ecaa159c5ecbc97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 02:44:17.511658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9095cbb9cff40099ecaa159c5ecbc97.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9095cbb9cff40099ecaa159c5ecbc97. Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:44:17.519955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 25 02:44:17.521365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Aug 25 02:44:17.522423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:44:17.523852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:44:17.524791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:44:17.526580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'id': 'a9095cbb9cff40099ecaa159c5ecbc97', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.528991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:17.531049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a9095cbb9cff40099ecaa159c5ecbc97. Aug 25 02:44:17.533912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.541965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280730-e857-46db-babc-b106dc213f75 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.543706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 483/936] 10.222.0.64 () {60 vars in 1140 bytes} [Thu Aug 25 02:44:17 2022] POST /identity/v3/projects => generated 262 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:17.544326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.647757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280730-e857-46db-babc-b106dc213f75 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:17.668161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf7ccc-25a6-472c-8dcd-910ef002a47d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:17.684865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:17.685498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.685773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.686044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.698007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:17.703131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:17.704246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:17.705347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 454/937] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:17.711446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:17.711446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.711446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.711446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.713124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.718813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:17.720610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:17.734169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:17.735205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:17.736286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:17.740325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 484/938] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:17.743906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.773622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:17.800033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:17.834332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45e6c18-6ea5-4d21-a169-537e3806e118 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:17.865860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c870aacd-58d5-47c3-a762-29f97a58d983 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:17.874643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:17.875173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.875549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.875966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.876768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:17.877173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:17.878752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:17.888369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 455/939] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:17.893536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:17.907271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:17.908380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:17.908787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:17.909164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:17.909999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:17.910405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:17.913424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:17.948439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 485/940] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:18.028613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb23eee-1b08-4489-9dcd-8e959f75ebd7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.044714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.070309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.070961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.071244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.071511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.084736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.086225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-995ffc85-1feb-429e-bfeb-b373f9fd046d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:18.102885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:18.103987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:18.105590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:18.105590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:18.105590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:18.105590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 456/941] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:18.114064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.175102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4e44-6f75-4604-a097-8aa5e1be0e44 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.175382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4e44-6f75-4604-a097-8aa5e1be0e44 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.175658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a4e44-6f75-4604-a097-8aa5e1be0e44 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.177196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 457/942] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:18.183016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.183295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.183569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.205951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:18.207729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:18.233409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60945879-b947-45af-90f3-53c54cffed77 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.238101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.275383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.276564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.277132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.277602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.278454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:18.279026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.280931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.294934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 486/943] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:18.300445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.301563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 458/944] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:18.409702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aa97e-f9ea-4bd1-9152-fb9fd72c5529 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.445932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.446617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.446891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.447161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.455401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.457139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:18.472446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:18.473454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:18.475067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 487/945] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:18.481517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.580233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.580878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.592065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a5bd3-bdf4-4a39-9767-e23f9e7e2bbe None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.609374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.645206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.645857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.646141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.646418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.647158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:18.647467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.648966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.668438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 459/946] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:18.673930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.713186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458c86-adeb-453b-8010-2b22ffbc95f0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.760258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.761384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.761775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.762161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.763773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.765532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:18.781980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:18.783764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:18.785290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:18.794546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 488/947] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:18.796376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.808980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626d12f-000d-455d-b0d2-1d90919fae9c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.846738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.847469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.847845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.848203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.862129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.863740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-952721ee-e1ba-4440-8375-8da8c738b0e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:18.883123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:18.884419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:18.885569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:18.885569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:18.885569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:18.888529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 460/948] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:18.893481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c75ee-883e-4f70-b1bd-9542b3d4043a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.893767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c75ee-883e-4f70-b1bd-9542b3d4043a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.894042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c75ee-883e-4f70-b1bd-9542b3d4043a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.895448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 461/949] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:18.896642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c75ee-883e-4f70-b1bd-9542b3d4043a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:18.900435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.917715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:18.931490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b96c66e-90bc-4869-ac15-7fe3fd37db15 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:18.974876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:18.975722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.976085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.976594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:18.977313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:18.977723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:18.979246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e2f6c-ba40-4b0e-a1e4-16c3c7408895 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:18.988428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 489/950] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:18.988428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:18.988428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:18.988428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.005090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:19.006693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:19.018324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c75ee-883e-4f70-b1bd-9542b3d4043a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.055249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.055983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.056554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.056735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.057431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:19.057808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.059252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.071842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 462/951] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:19.077092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.083805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 490/952] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:19.083805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.164857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.177747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.203137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57cd7a-dc58-4c0b-8c34-ae71fae85df2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.215769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84f844-3ee1-4098-94f5-aae6d43ab7cd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.247391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.248741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.249408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.250050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.259542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.260159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.260470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.260747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.260940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.261381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:19.261681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.263010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.263134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.269385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 463/953] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:19.275333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:19.276780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:19.277809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:19.278776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:19.281176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 491/954] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:19.292445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.387582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b673624-2706-4049-8d81-bdbbaf6b09d0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.393454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2cf99-18cc-43c7-ac67-2ae7f0a17f8d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.424294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.429990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.430609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.430890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.431166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.431883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:19.432187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.433662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.435370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.436583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.437066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.437522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.438384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.439937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.446722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 492/955] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:19.447548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.450246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.480556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 464/956] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:19 2022] POST /identity/v3/endpoints => generated 349 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:19.480556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.576001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05d87c-b33b-4575-a209-bc26e3bbc6e9 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.626791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.627976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.628250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.628556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.629140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.631423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.632166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adbd08-ad8e-4087-8ce5-f5c72c3cb11c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:19.641337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:19.642457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:19.643323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:19.647609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 493/957] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:19.648955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.682703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.683445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.683827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.684326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/e0de8775c6564365b4a7c3268392b258/roles/2b8df647ad294701ae3b6420f8f1fab8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.687580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=e0de8775c6564365b4a7c3268392b258, role_id=2b8df647ad294701ae3b6420f8f1fab8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.690539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.709225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 465/958] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:19 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/e0de8775c6564365b4a7c3268392b258/roles/2b8df647ad294701ae3b6420f8f1fab8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:19.732702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.780806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934c17e-bc80-4a89-9738-7e9d40090926 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.820941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.821662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.822011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.822352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.823070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:19.823493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.824995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f712b-ed01-4f5a-abb1-1984b62ca423 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:19.834568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 494/959] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:19.837680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:19.885218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:19.947714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614cf7a-d11b-4018-91fc-43c6749df29b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:19.983281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:19.984000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:19.984348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:19.984716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:19.985426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:19.985858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:19.987410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec9e814-9e3d-46d5-a897-386ebcf1c722 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:20.000588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 466/960] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:20.087007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bb62a-7b4e-4abf-8290-223bf583a14b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:20.087388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bb62a-7b4e-4abf-8290-223bf583a14b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:20.087790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2bb62a-7b4e-4abf-8290-223bf583a14b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:20.089592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 495/961] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:20.095222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:20.095745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:20.096169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:20.117367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:20.118880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:20.191380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 467/962] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:20.472874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bb62a-7b4e-4abf-8290-223bf583a14b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:20.583438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2bb62a-7b4e-4abf-8290-223bf583a14b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:20.611584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:20.620728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:20.621853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:20.622501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:20.623034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:20.624083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:20.625723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:20.641102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.sql.core [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:44:20.641102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 02:44:20.641102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [parameters: {'user_id': 'b64017ad4c6b4388a77278897669b153', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 02:44:20.641102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81623) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:44:20.649175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:44:20.650094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application yield resource Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise self.value Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application session.commit() Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:44:20.651076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:44:20.651998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:44:20.652943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application result.read() Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:44:20.653835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b64017ad4c6b4388a77278897669b153', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:20.654693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 25 02:44:20.655516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:20.660443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 496/963] 10.222.0.64 () {60 vars in 1131 bytes} [Thu Aug 25 02:44:20 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:20.661991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:20.695550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:20.771019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530f842-66c8-4775-acc0-bf2acc016ae6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:20.806602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:20.807247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:20.807524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:20.807797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:20.815379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:20.816863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8da0888b-2a7b-425c-8d42-35016aa109c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:20.829275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:20.831464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:20.832737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 468/964] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:20.837176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:20.947725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb4653-87dd-4a0d-9895-cbdbeb8b3472 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:20.982831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:20.983447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:20.983726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:20.983997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:20.984732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:20.985036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:20.986679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1c8eed-eebf-4950-bf4a-7684612d51b1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:21.032521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 497/965] 10.222.0.64 () {56 vars in 1101 bytes} [Thu Aug 25 02:44:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:21.612598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c4baf-cdb5-4cb3-b7aa-516101d7f3e9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:21.612990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c4baf-cdb5-4cb3-b7aa-516101d7f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:21.613194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c4baf-cdb5-4cb3-b7aa-516101d7f3e9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:21.615221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 469/966] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:21.620650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88957ac-d887-4144-bb51-78ac4e3310e7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:21.621085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88957ac-d887-4144-bb51-78ac4e3310e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:21.621248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88957ac-d887-4144-bb51-78ac4e3310e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:21.640916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e88957ac-d887-4144-bb51-78ac4e3310e7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:21.642532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e88957ac-d887-4144-bb51-78ac4e3310e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:21.689448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:21.720448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 498/967] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:21.781380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073f0c1-2b89-4eba-9a8e-66cfdc3de8d4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:21.781955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073f0c1-2b89-4eba-9a8e-66cfdc3de8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:21.781955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3073f0c1-2b89-4eba-9a8e-66cfdc3de8d4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:21.783369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 470/968] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:21.789479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f2a0-c17c-4440-ba01-b123220def7e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:21.789763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f2a0-c17c-4440-ba01-b123220def7e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:21.790039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5f2a0-c17c-4440-ba01-b123220def7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:21.808229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-47c5f2a0-c17c-4440-ba01-b123220def7e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:21.809471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-47c5f2a0-c17c-4440-ba01-b123220def7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:21.879784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 499/969] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:21.995647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d191a-d247-4cad-99b1-8f8064a48587 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:21.995993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d191a-d247-4cad-99b1-8f8064a48587 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:21.996178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d191a-d247-4cad-99b1-8f8064a48587 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:21.997701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 471/970] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:22.002910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.003194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.003483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.004143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d191a-d247-4cad-99b1-8f8064a48587 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.023724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:22.024963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:22.113371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.120561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 500/971] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:22.125290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d191a-d247-4cad-99b1-8f8064a48587 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.149315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.166796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.167429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.167710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.167984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.168593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.170080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:22.179166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:22.180281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:22.181392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 472/972] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:22.186348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.197550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.284438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7f194-db0e-4adf-a138-940f4a3b351e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.304813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb8a642-92af-4817-b8e8-79c65c6aacc6 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.327193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.327852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.328131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.328412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.340709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:22.343563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.344247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.344625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.344989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:22.345348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:22.346264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:22.347230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:22.348113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:22.348113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.348113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.351505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 501/973] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:22.352488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.358524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 473/974] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:22.359267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.387298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.462538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.468959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa33d5-2a0c-4702-a8de-5b18c804bf95 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.471102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c581464-a0ff-4b2f-afbe-d694bb0f2197 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.504291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.505488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.505765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.506034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.506701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:22.507004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.507918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.508461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.508591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.508828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.509098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.509729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:22.510027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.511383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.516919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 502/975] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:22.517706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.524962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 474/976] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:22.524962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.611127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.626218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a33d18-b5a1-4b09-9378-7db227be4ad4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.633141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641327b-b49f-4756-83d0-dcbac94d65f4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.665648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.666339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.666621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.666897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.667543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.668568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.668950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.669194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.669468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.669735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.679919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.681397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.683958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 503/977] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:22 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:22.685354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:22.697748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:22.698865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:22.699922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:22.699922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:22.699922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:22.699922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 475/978] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:22.705767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.716097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.830302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15cd398-7ddc-41a4-adfb-c0a87bb2dfbb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.831558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec3105-bb8b-47ea-9ce0-67b14393953f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:22.871333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.871823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.872092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.872374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.873106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:22.873410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.873735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:22.874348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:22.874631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:22.874790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.874886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:22.875606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] RBAC: Adding query filter params (interface=admin, service_id=4e91873739364cbe9ce08862f9ce2608, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:22.875915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:22.877316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:22.882350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:22.883682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 504/979] 10.222.0.64 () {56 vars in 1249 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/endpoints?service_id=4e91873739364cbe9ce08862f9ce2608&interface=admin®ion_id=RegionOne => generated 193 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:22.889542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 476/980] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:22.890959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.895024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:22.983079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:23.003683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401d1e66-bbcc-43de-8ff1-0a94b546cb7d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.011772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176079a1-3d40-42e3-92d7-bbcd848d678c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.043278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.044024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.044309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.044786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.049864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.050601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.050783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.051035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.051650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.052609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.053071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.054060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.061424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 505/981] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/services => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:23.067706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:23.068837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:23.070540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 477/982] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:44:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:23.075107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:23.197343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1544b82-9085-486e-8d6c-550a2dc4b889 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.235566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.236176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.236482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.236760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.237494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:23.237805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.239267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.255702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:23.260572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 506/983] 10.222.0.64 () {56 vars in 1149 bytes} [Thu Aug 25 02:44:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:23.266551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:23.330438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:23.381643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86672a9d-8f90-4596-9b53-c8db04c73c0d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.420719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.421340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.421619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.421893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.494254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.495634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.557495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:23.608913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 478/984] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:23 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:23.610080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:23.714252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2c23a4-6502-43af-bc25-cba086328f48 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.751160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.751723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.751999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.752270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.762925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.764409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:23.779808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:23.780947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:23.787713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:23.787713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:23.787713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:23.787713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 507/985] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:23.788171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:23.888916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e783ce-0a07-4716-8d0b-d2c2df94acfa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:23.922590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:23.923194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:23.923473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:23.923744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:23.924378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:23.924704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:23.926148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:23.938343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 479/986] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:23.943815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:23.999429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:24.052543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeace5de-e3b3-4414-8510-4b8938c023ec None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:24.084682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:24.085318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:24.085597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:24.085867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:24.092731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:24.094174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:24.106157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:24.107089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:24.108002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 508/987] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:24.113114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:24.133348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:24.221359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450776d-7688-42c9-885b-41d5774c9349 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:24.255580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:24.256197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:24.256505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:24.256785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:24.257478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:24.257785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:24.259218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ad4f8-1a7f-4c08-aa8e-2ab7a6b02c05 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:24.276470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 480/988] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:24.278095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:24.384876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80281612-5b07-4dcd-a8d1-bbfb69d7c6fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:24.399039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:24.425035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:24.425642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:24.425923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:24.426263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:24.427049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] RBAC: Adding query filter params (role.id=2b8df647ad294701ae3b6420f8f1fab8, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=e0de8775c6564365b4a7c3268392b258) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:24.427309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:24.428750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e800db-f1e1-433b-90ad-888d55817842 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:24.444422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 509/989] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:24 2022] GET /identity/v3/role_assignments?user.id=e0de8775c6564365b4a7c3268392b258&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=2b8df647ad294701ae3b6420f8f1fab8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:24.617275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984c55-58c7-4ac7-861b-b6b69291c0ed None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:24.617556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984c55-58c7-4ac7-861b-b6b69291c0ed None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:24.617821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2984c55-58c7-4ac7-861b-b6b69291c0ed None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:24.619157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 481/990] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:24.625414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4df6-e772-4786-aa09-2dbfd41e0516 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:24.625697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4df6-e772-4786-aa09-2dbfd41e0516 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:24.625983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4df6-e772-4786-aa09-2dbfd41e0516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:24.646229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f3e4df6-e772-4786-aa09-2dbfd41e0516 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:24.647505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f3e4df6-e772-4786-aa09-2dbfd41e0516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:24.717955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 510/991] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:24 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:24.986001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984c55-58c7-4ac7-861b-b6b69291c0ed None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.008066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1622e-2d9f-4c7d-8cb7-402b3de1ff17 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.008433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1622e-2d9f-4c7d-8cb7-402b3de1ff17 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.008660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1622e-2d9f-4c7d-8cb7-402b3de1ff17 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.010665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 511/992] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:25.015812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.016012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.016288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.036047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:25.037614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:25.073917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.099436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2984c55-58c7-4ac7-861b-b6b69291c0ed None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.113389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 512/993] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:25 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:25.137493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.138132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.138411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.138679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.139265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.140662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:25.149617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:25.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:25.153492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 482/994] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:25.156708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.194153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.261252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dea7e-c0ec-49c1-aa46-b1a994a4569c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.294941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.295544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.295823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.296096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.296745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:25.297047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.298405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.303837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 513/995] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:25.309307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.396155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.425233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44cf03-c892-44d0-a7d3-733b5fb61355 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.464850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.465480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.465835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.466103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.466882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:25.467179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.468749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.474419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 483/996] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:25.479970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.488813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.515251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab8056-c68b-4df0-89a8-7f9f04544fb5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.523089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.559080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.559716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.559994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.560263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.560871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.562242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:25.571679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:25.572778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:25.573654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 514/997] 10.222.0.64 () {56 vars in 1126 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:25.578694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.608675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff91d5a-3a14-4665-836e-54a1f23d0273 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.642920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.643533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.643815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.644090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.644874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] RBAC: Adding query filter params (interface=public, service_id=e834b27286ea4f3eb335a598f8bc2d63, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:25.645924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.647836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.652987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 484/998] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/endpoints?service_id=e834b27286ea4f3eb335a598f8bc2d63&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:25.658291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.699612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa60ec-23ce-4427-a99b-ecda4f0a4ebf None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.728262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.738412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.739577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.740040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.741032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.742214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:25.743053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.744900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.752773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 515/999] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:25.756532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:25.761607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65344b4b-8c51-4fce-9d0c-79f92cdb3463 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.794616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:25.798983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.799589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.799871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.800146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.800769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.802263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.809279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 485/1000] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:44:25.877965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8aea46-1749-4aa9-b2aa-3b9ae4a81a00 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:25.915723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:25.916345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:25.916646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:25.916918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:25.917561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:25.917859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:25.919252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab2416-f007-4c93-bdee-29354cb9ac44 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:25.929871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 516/1001] 10.222.0.64 () {56 vars in 1122 bytes} [Thu Aug 25 02:44:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:25.931519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:26.039356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aed8cf-4b58-4e86-96fd-a1ce63c7f1e7 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:26.073830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:26.074476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:26.074659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:26.074890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:26.075545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:26.077050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351f39e-e273-482c-a325-5b69913c2296 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:26.081808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:26.100425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 486/1002] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:26.389815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b2c5-0489-418a-a63a-69cb911ae417 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:26.390109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b2c5-0489-418a-a63a-69cb911ae417 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:26.390390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b2c5-0489-418a-a63a-69cb911ae417 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:26.391897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 517/1003] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:26.397083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:26.397418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:26.397768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:26.419060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:26.420262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:26.500995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 487/1004] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:26 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:26.767998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816b2c5-0489-418a-a63a-69cb911ae417 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:26.863503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:26.875241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816b2c5-0489-418a-a63a-69cb911ae417 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:26.911652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:26.912286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:26.912588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:26.912862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:26.913437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:26.914800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:26.923332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:26.924317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:26.925251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 518/1005] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Aug 25 02:44:26 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:26.932446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:27.032477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daaca9f-75eb-4961-864a-084584f60b60 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:27.053388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:27.072668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:27.073555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:27.073996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:27.074269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:27.074936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] RBAC: Adding query filter params (name=image) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:27.075240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:27.076638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f741764-b95d-4d48-a41a-3934b94393ab None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:27.081998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 488/1006] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:27.087926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:27.193538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602a24e-c236-4d52-b44e-0a73695fcf66 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:27.228510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:27.229123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:27.229400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:27.229671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:27.230292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:27.230592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:27.231948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e7a1e-9d8a-4327-9aff-72a253801545 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:27.236642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 519/1007] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:27 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:27.754116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794191e1-cd5f-4ace-9252-e22dd1a02b1f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:27.754966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794191e1-cd5f-4ace-9252-e22dd1a02b1f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:27.755222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794191e1-cd5f-4ace-9252-e22dd1a02b1f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:27.756745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 489/1008] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:27.761777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f65aac-e793-4792-918f-735176b3f945 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:27.762064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f65aac-e793-4792-918f-735176b3f945 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:27.762342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f65aac-e793-4792-918f-735176b3f945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:27.781678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b1f65aac-e793-4792-918f-735176b3f945 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:27.782910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b1f65aac-e793-4792-918f-735176b3f945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:27.797993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:27.852644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 520/1009] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:27 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:28.024721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820a4f-db3e-4ae7-90f4-823d3925fcdc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.025018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820a4f-db3e-4ae7-90f4-823d3925fcdc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.025184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820a4f-db3e-4ae7-90f4-823d3925fcdc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.026657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 490/1010] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:28.031798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.032084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.032359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.050098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:28.051805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:28.119312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 521/1011] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:28.123741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e820a4f-db3e-4ae7-90f4-823d3925fcdc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.232224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e820a4f-db3e-4ae7-90f4-823d3925fcdc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.269504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.270730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.271007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.271282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.271860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.273298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:28.282740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:28.283752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:44:28.284682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:28.288699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 491/1012] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:28.289861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.372107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:28.387291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.394427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559fe0a6-e314-4634-8a0e-21633dba9a5d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.432118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.432747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.433023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.433719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.434590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:28.434713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.436022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.441233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 522/1013] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:28.447514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.448487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:28.503770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733490c-d7b0-47c9-a75f-fb23d8b2f9d1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.541113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.541660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.541932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.542459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.543280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.544775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.546333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 492/1014] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:28.552768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.553978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0866e-8bd8-42c2-980e-058ca4fceed3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.589595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.590206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.590489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.590762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.591395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:28.591693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.593078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.598104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 523/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Thu Aug 25 02:44:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:28.604686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:28.617441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:28.682229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ae69-b6ac-4ef0-8e25-aa8efd02720e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.699362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:28.718299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.718906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.719181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.719450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.720084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.720532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb0021c-5fa2-4383-941f-8aec5655d414 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:28.721561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ca9d8-75a1-4c35-97d1-c2b77df7c2de None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.752426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 493/1016] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:28 2022] POST /identity/v3/projects => generated 311 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:28.761630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:28.762309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:28.762586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:28.762904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:28.763699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:28.765212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516414b-b314-4245-bce8-700fc8121379 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:28.800511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 524/1017] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:29.174136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0642-7199-43dc-94fc-be750426cd37 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:29.174643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0642-7199-43dc-94fc-be750426cd37 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:29.174749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b0642-7199-43dc-94fc-be750426cd37 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:29.176160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 494/1018] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:29.181877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b36a-354a-4c4e-96f9-c7982c8e4eb3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:29.182163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b36a-354a-4c4e-96f9-c7982c8e4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:29.182436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5b36a-354a-4c4e-96f9-c7982c8e4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:29.200146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d6e5b36a-354a-4c4e-96f9-c7982c8e4eb3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:29.201376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6e5b36a-354a-4c4e-96f9-c7982c8e4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:29.263731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:29.280797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 525/1019] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:29 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:29.552708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0642-7199-43dc-94fc-be750426cd37 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:29.656492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b0642-7199-43dc-94fc-be750426cd37 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:29.691440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:29.692592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:29.692874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:29.693146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:29.694205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:29.695916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cc4fd-8904-42e9-b25f-9d62eee6b1a0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:29.710914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 495/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:29 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:30.723559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64a8a-612a-4920-8ff0-35951998c8b6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:30.724103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64a8a-612a-4920-8ff0-35951998c8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:30.724103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d64a8a-612a-4920-8ff0-35951998c8b6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:30.725659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 526/1021] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:30.730822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e45e-2a0a-4b59-9e7b-9d5ac858cc8d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:30.731224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e45e-2a0a-4b59-9e7b-9d5ac858cc8d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:30.731402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844e45e-2a0a-4b59-9e7b-9d5ac858cc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:30.750712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6844e45e-2a0a-4b59-9e7b-9d5ac858cc8d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:30.751918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6844e45e-2a0a-4b59-9e7b-9d5ac858cc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:30.775682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:30.833668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 496/1022] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:30.838535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115753-ea26-4cac-80ec-bf307a8df5f9 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:30.838815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115753-ea26-4cac-80ec-bf307a8df5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:30.839080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd115753-ea26-4cac-80ec-bf307a8df5f9 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:30.840657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 527/1023] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:30.845598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:30.845887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:30.846162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:30.864796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:30.866242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:30.935350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 497/1024] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:30 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:31.121474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115753-ea26-4cac-80ec-bf307a8df5f9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.202649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.230631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd115753-ea26-4cac-80ec-bf307a8df5f9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.273908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.274585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.274865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.275140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.276357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:31.277944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:31.279694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 528/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:31.285004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.292820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:31.311186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78090625-29e7-4c5b-9524-3b3250180296 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.348889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:31.351103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.351732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.352039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.352313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.363185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:31.368078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:31.369063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:31.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 498/1026] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:31.375014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.398593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc78b1f-7bb8-43a6-91ab-abaf5c451ec2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.447094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.447993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.448274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.448578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.449221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:31.451487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:31.476576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 529/1027] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:44:31 2022] POST /identity/v3/users => generated 285 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:31.493125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc44d4d-c87d-4653-ada0-5a2b623899e5 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.538500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.539130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.539406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.539675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.540358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:31.540691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:31.542101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d5b89-d568-4b73-a368-860a64eb14e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:31.556534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 499/1028] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:31.558009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.641322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623a21-b31d-49c0-95ab-7ec81fe4218e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.641566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623a21-b31d-49c0-95ab-7ec81fe4218e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.641790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3623a21-b31d-49c0-95ab-7ec81fe4218e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.643119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 500/1029] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:31.649241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.649521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.649793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.664130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:31.671222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:31.673116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:31.679829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29e194-ae91-48e3-806c-f88f9b7dbd41 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.694969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:31.719249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.719893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.720174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.720477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.731490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:31.732988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:31.751292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:31.752429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:31.753347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:31.753347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:31.753347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:31.753347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 530/1030] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:31.760025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:31.764561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 501/1031] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:31 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:31.861842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f799f50-4bce-40df-adb7-b2b58d7b0918 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:31.902655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:31.903173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:31.903448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:31.903716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:31.904347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:31.904679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:31.906050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:31.919302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 531/1032] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:31.924837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.026833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b23d2-49d8-404d-82cc-1d0e99e22fb2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.030726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.060626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.064233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.064911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.065196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.065468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.068906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.074500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.076372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:32.087915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:32.088967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:32.089970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 502/1033] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:44:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:32.094882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.143265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7108458-0cfa-489e-bc1f-7087fbb34a8d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.181076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.181709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.181989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.182262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.182843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.184230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:32.192823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:32.193851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:32.195039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 532/1034] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:32.200580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.213667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f780d18-3ce3-4297-97ff-aa82508e624f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.252198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.252832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.253110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.253384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.254140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:32.254450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.255916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.275312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 503/1035] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:32.280758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.301521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.312832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ffe6-87c6-4f66-81f0-ba894d23d9f6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.342358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.348741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.349358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.349630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.349899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.350528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] RBAC: Adding query filter params (name=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:32.350833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.352196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.360552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 533/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:32.362827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.398469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c47f50-3152-4682-83b8-9638aec4308f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.438282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.438789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.439069 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.439343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.476529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799cf7e-491d-4239-b5e1-c17fdbdbd752 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.512304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.512954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.513230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.513506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.514139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] RBAC: Adding query filter params (type=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:32.514436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.515635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.515933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.517403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.522589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 534/1037] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:32.529358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.549575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.585007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.636665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 504/1038] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:44:32.638015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.645556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1edcc4-5f1f-457d-9e01-cc153ab743e2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.690091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.690619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.690902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.691179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.692405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] RBAC: Adding query filter params (interface=public, service_id=c3ae56667d914de19606b672c03e8440, region_id=RegionOne) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:32.692781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.694214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.699299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 535/1039] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/endpoints?service_id=c3ae56667d914de19606b672c03e8440&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:32.705050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.747458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967483bd-c3d6-4643-a213-82ecf75cbb40 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.783973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.785448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.785869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.786296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.788332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.798108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.799717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.808317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e11c-b394-4701-bd37-dcbb23bcebb2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:32.814175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:32.815371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:32.817023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:32.817023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:32.817023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:32.818735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 505/1040] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:32.823938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:32.834578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:32.850954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.851561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.851833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.852097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.852722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.854309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:32.872423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 536/1041] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:44:32.948203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc12d72-681a-4105-98ce-a0e9517f56de None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:32.985021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:32.985639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:32.985922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:32.986196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:32.986858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:32.987163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:32.988633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:33.006911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 506/1042] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:33.008487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:33.111398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03c1f96-5843-469f-b918-fa33039814b4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:33.146964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:33.147894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:33.148383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:33.148866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:33.155829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:33.157527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:33.169013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:33.169961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:33.170885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:33.172815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 537/1043] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:33.179103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:33.247377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:33.284587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d63144-a28d-4630-8974-cb24cfe419e3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:33.322547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:33.323159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:33.323433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:33.323698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:33.324426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:33.324720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:33.326166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9757f-3f29-4cbc-afe4-467bec504915 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:33.338574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 507/1044] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:33.344589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:33.354053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:33.458054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db8612b-586b-4107-9948-079ae6a297c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:33.486169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f6a9-de93-49ef-94a8-62bb03da97d7 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:33.486460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f6a9-de93-49ef-94a8-62bb03da97d7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:33.486744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd8f6a9-de93-49ef-94a8-62bb03da97d7 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:33.488202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 508/1045] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:33.493498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:33.493811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:33.494090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:33.494189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:33.494361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:33.494468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:33.494728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:33.495442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] RBAC: Adding query filter params (role.id=2b8df647ad294701ae3b6420f8f1fab8, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:33.495746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:33.497193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:33.504146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 538/1046] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:33 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=2b8df647ad294701ae3b6420f8f1fab8 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:33.512818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:33.514168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:33.590858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 509/1047] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:33.858298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:33.929491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:33.965424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe056b-6996-4bae-b289-4ae63fa627cb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.000409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.001054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.001331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.001600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.012415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:34.017075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:34.018011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:34.018874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:34.026869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 539/1048] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:34.027013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:34.081139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:34.126906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37397fc-e822-4e9d-b51e-5bb9caef6626 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.163304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.163915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.164193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.164542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.165244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:34.165545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:34.166913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:34.175417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 510/1049] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:34.181201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:34.289249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5177440-830a-4737-b89a-daadf7228f9e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.319207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:34.326380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.327031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.327312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.327587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] PATH_INFO: `/v3/users/0d276129efdd49609651b55d7c39d21f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.342638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=0d276129efdd49609651b55d7c39d21f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:34.344098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:34.352616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 540/1050] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:34 2022] GET /identity/v3/users/0d276129efdd49609651b55d7c39d21f => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:34.352809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:34.464924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da11e9e-857d-41e1-a4ae-91ed78071f53 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.483219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:34.502592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.503209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.503488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.503763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.578032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:34.579555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf99b9-255e-4882-af05-d6c52244151f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:34.690885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 511/1051] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:34 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:34.692821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:34.799870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599659d-5dec-4eb1-b5e2-80b4d9c8cbe3 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.814948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a484e5-3dfb-4b53-aadb-197c36515434 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.815245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a484e5-3dfb-4b53-aadb-197c36515434 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.815515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a484e5-3dfb-4b53-aadb-197c36515434 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.817603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 512/1052] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:34.822506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.822789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.823063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.837019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.837647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.837931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.838260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.839574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:34.841043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:34.841148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:34.842316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:34.847665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 541/1053] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:34 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:34.848816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:34.860692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:34.908679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:34.923432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 513/1054] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:34.955279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba2e3fc-b385-4dc2-b7dc-e609f170023e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:34.990961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:34.991551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:34.991830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:34.992102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:34.992866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=87240a320519451bb52d100e67d495b2, user.id=0d276129efdd49609651b55d7c39d21f) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:34.993175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:34.994669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:35.000423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 542/1055] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:34 2022] GET /identity/v3/role_assignments?user.id=0d276129efdd49609651b55d7c39d21f&scope.project.id=87240a320519451bb52d100e67d495b2&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:35.191895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:35.294841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708c008-062f-47db-a0ca-6f2119ecc8b9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:35.329457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:35.330098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.330375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.330644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] PATH_INFO: `/v3/services/image` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.331223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:35.333160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-97bfbfe1-62bf-4379-9b98-27cf9b8cfe96 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:35.342111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:35.343127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:44:35.343964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:35.348532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 514/1056] 10.222.0.64 () {56 vars in 1105 bytes} [Thu Aug 25 02:44:35 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:35.349863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:35.405599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00a7-467e-4608-8e21-714d68ea3800 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.405927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00a7-467e-4608-8e21-714d68ea3800 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.406147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef00a7-467e-4608-8e21-714d68ea3800 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.407524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 515/1057] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:35.413379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.413659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.413930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.432869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:35.434058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:35.442964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:35.474753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00429aea-3449-490c-82f5-a5b49c274943 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:35.498204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:35.516453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:35.516453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.516453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.516453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.516925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] RBAC: Adding query filter params (name=image) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:35.516925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:35.517627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:35.520754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 516/1058] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:35.524449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 543/1059] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:35.529130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:35.632090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabf275-e6a4-49bb-9b55-d7ab56780fc7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:35.667918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:35.668564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.668845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.669121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.669752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] RBAC: Adding query filter params (type=image) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:35.670054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:35.671427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:35.682446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 517/1060] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:35.683388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:35.786127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfbffc-ffa4-4e23-89f7-96bc182e3376 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:35.794297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:35.803317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:35.825218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:35.825835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.826116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.826384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.827048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:35.828449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:35.860422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 544/1061] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:44:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:44:35.913003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7403931-1e0a-4615-9f78-e6c4f50663e4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:35.966031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:35.966678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:35.966957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:35.967225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:35.980090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:35.984962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:35.985982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:35.986841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 518/1062] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:35.992589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.051405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:36.114039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f99c676-dfb9-491b-b8e3-cc8d7521e81c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:36.148597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:36.149207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.149483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.149753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.150424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:36.150727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:36.152087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:36.160499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 545/1063] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:36.166636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.231709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:36.273995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a89d5-41a4-4232-8e1d-17193a39fc1c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:36.308075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:36.308727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.309004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.309271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.320994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:36.322455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:36.337204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:36.338196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:36.339190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:36.339190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:36.339190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:36.340465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 519/1064] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:36.344112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.459163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d518bf-b695-42aa-83a5-321a804f1314 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:36.460672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:36.494558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:36.495164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.495441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.495706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.496341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:36.496667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:36.498053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:36.515400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 546/1065] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:36.516862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.622210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a312a1-4740-46db-acd0-a1a27b86c454 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:36.636447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:36.658354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:36.659059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.659345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.659623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.667531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:36.669023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:36.680104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:36.682168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:36.683123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:36.684230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 520/1066] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:44:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:36.687215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.792836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf70c17-243d-4142-afb5-4195e59c5159 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:36.828295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:36.828933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.829214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.829485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.830204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:36.830510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:36.831954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f557dd74-b51e-44c5-aae5-3656737adf60 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:36.853498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 547/1067] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:44:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:36.854979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:36.916518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd28f-1ec4-4f6d-b9e4-0102511ab77a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.916837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd28f-1ec4-4f6d-b9e4-0102511ab77a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.917119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dd28f-1ec4-4f6d-b9e4-0102511ab77a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.918484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 548/1068] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:36.923711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:36.923997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:36.924274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:36.947422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:36.948688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:36.964501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:36.968969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce316a-4811-4074-ba5b-2b7ff1802a28 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.013677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.014718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.015259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.015649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.021794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 549/1069] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:37.028138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.029702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:37.043433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:37.044361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:37.050570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:37.050570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:37.050570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:37.050570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 521/1070] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:37.051355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.154700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f841-ca04-4365-a8b0-ff354c031ec1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.189380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.189978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.190253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.190521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.191150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:37.191479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.192860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.204333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 550/1071] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:37.209793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.238961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.298479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.312453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.319553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416ccfc-1a4f-42fe-b567-b872e92774ff None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.358919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.359479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.359764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.360052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.367909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.369218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:37.381186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:37.382170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:37.383093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 522/1072] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:37.388081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.409477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2add0-f5ae-42ad-a63c-ed585e46b5b1 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.445980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.447292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.447753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.448505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.460183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:37.465165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:37.466376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:37.467544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:37.468617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 551/1073] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:37.475205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.496889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.513989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a712e6-804f-4ec5-8301-503fbba1a055 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.550428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.551057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.551338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.551609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.552528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:37.552661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.553123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.554066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.567345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 523/1074] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:37.573119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.596163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9833d2-aee5-4ac4-8f0c-f3aca008e253 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.632959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.633564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.633839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.634112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.634761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:37.635062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.636575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.648433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 552/1075] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:37.652171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.695659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af647462-1a93-40ba-a788-79d6a79ff6a4 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.730823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.731477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.731754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.732024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/2b8df647ad294701ae3b6420f8f1fab8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.734231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=02cff3a52a8e47feb0acc62f084f110a, role_id=2b8df647ad294701ae3b6420f8f1fab8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.735657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.755546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 524/1076] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:37 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/02cff3a52a8e47feb0acc62f084f110a/roles/2b8df647ad294701ae3b6420f8f1fab8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:37.775460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceae68-87f0-4560-9d66-9632ce1a3c12 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.809110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.816068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.816774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.817050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.817320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] PATH_INFO: `/v3/users/0d276129efdd49609651b55d7c39d21f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.818573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] RBAC: Authorizing `identity:get_user(user_id=0d276129efdd49609651b55d7c39d21f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.820047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66080c35-a1a5-48d5-a88a-5beee25c9db0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:37.821755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 553/1077] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/users/0d276129efdd49609651b55d7c39d21f => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:37.828076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:37.837978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:37.858805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67ef9-5592-470c-a40a-690ddf4ca720 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.859105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67ef9-5592-470c-a40a-690ddf4ca720 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.859377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd67ef9-5592-470c-a40a-690ddf4ca720 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.861096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 554/1078] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:37.866913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.867215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.867468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.886464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:37.887708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:37.961134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7adf35-f6a5-4293-96b0-b147313deb92 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:37.965913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 555/1079] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:37.995985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:37.996655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:37.996934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:37.997205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:37.998368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:37.999804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:38.006964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 525/1080] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:37 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:38.008519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:38.108252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb74e7-aa52-47d9-8518-50c0b41104da None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:38.137476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:38.145056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:38.145721 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:38.146006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:38.146284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2/users/0d276129efdd49609651b55d7c39d21f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:38.148222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] RBAC: Authorizing `identity:create_grant(project_id=87240a320519451bb52d100e67d495b2, user_id=0d276129efdd49609651b55d7c39d21f, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:38.149720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:38.163745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 556/1081] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:38 2022] PUT /identity/v3/projects/87240a320519451bb52d100e67d495b2/users/0d276129efdd49609651b55d7c39d21f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:38.241227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:38.325873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:38.353049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03446f4f-abce-48c5-add1-675b40a28626 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:38.393500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:38.394121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:38.394434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:38.394708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:38.465204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:38.466664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:38.542932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:38.576467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 526/1082] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:38.578135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:38.681483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85c04-866b-40ce-960f-0f76bd2cbc5d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:38.715923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:38.716596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:38.716875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:38.717145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:38.728210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:38.729713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-9bdcd56d-5364-459e-8a93-8d0d8f139821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:38.746872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:38.747887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:38.753058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:38.753058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:38.753058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:38.753058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 557/1083] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:38.755773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:38.857648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f5760-bc59-4854-a566-a9b42329c774 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:38.893986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:38.894616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:38.894895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:38.895164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:38.895797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:38.896097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:38.897494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c92bae5-94d0-44e0-948e-3f1b02f4a771 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:38.916431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 527/1084] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:39.703846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a45-2441-4086-8946-91a67cfcd830 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:39.704450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a45-2441-4086-8946-91a67cfcd830 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:39.704450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f000a45-2441-4086-8946-91a67cfcd830 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:39.705766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 558/1085] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:39.711698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bce-078d-4bfe-9292-ec657f40a09b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:39.712143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bce-078d-4bfe-9292-ec657f40a09b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:39.712257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dd8bce-078d-4bfe-9292-ec657f40a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:39.730685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c8dd8bce-078d-4bfe-9292-ec657f40a09b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:39.731855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c8dd8bce-078d-4bfe-9292-ec657f40a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:39.758795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:39.798602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 528/1086] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:40.070231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000a45-2441-4086-8946-91a67cfcd830 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.094806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc741e-82df-493c-b849-1fcf4a027730 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.095091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc741e-82df-493c-b849-1fcf4a027730 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.095385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc741e-82df-493c-b849-1fcf4a027730 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.096758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 529/1087] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:44:40.102243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.102587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.102950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.116380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.121759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:40.122946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:40.174840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f000a45-2441-4086-8946-91a67cfcd830 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.190325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 530/1088] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:44:40.208864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.209484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.209760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.210030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.219889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:40.225003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:40.226040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:40.226872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 559/1089] 10.222.0.64 () {56 vars in 1120 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:40.231973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.334333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.341636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a88a7-58b4-4fd8-807f-57889bc3d654 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.376055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.376695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.376970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.377240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.377944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:40.378235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.379604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.388361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 531/1090] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:40.393948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.460845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.494460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e94b3-736b-47fe-912f-f1a6621d5415 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.495981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.528785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.529418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.529697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.529972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.541042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.542489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:40.557384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:40.558378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:40.559312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:40.559312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:40.559312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:40.559312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 560/1091] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:40.563959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0993715d-a492-4021-b995-31d22fd8c032 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.566135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.600828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.601372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.601654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.601929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.613104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:44:40.618140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:40.619288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:40.620365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 532/1092] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:40.625292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.643009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.669225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07f2ed3-7773-4877-aa29-7c28df523868 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.701857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.702464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.702738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.703010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.703645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:40.703941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.705321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.718321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 561/1093] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:40.724723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.729937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68643cc-4716-4dff-9be3-f6b61be5ecfa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.739858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.765873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.766487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.766767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.767039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.767701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:40.768003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.769922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.778969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 533/1094] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:40.784851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.828377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711745d-df36-425c-8b43-5f29348ff950 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.862124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.862676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.862976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.863258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.863606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.871286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.872763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:44:40.884177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:40.885181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:40.886720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 562/1095] 10.222.0.64 () {56 vars in 1093 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:40.887485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cad656-5b29-4780-9b7f-76100d6db8cc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:40.891021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.920963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:40.921678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:40.921970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:40.922242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] PATH_INFO: `/v3/users/0d276129efdd49609651b55d7c39d21f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:40.923386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] RBAC: Authorizing `identity:get_user(user_id=0d276129efdd49609651b55d7c39d21f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:40.924851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:40.926463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 534/1096] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/users/0d276129efdd49609651b55d7c39d21f => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:40.932504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:40.965976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:40.991526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097338d-a74a-4d2a-aee2-00bce838b309 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.026882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.027487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.027829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.028112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.028894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:41.029197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.030616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.030723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b45c19d-9b98-45a6-bed3-5331a070979b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.047344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 563/1097] 10.222.0.64 () {56 vars in 1133 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:41.053290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.064504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.065112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.065387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.065717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.081151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.135973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.137375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.153760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a349f4-f465-44cc-803c-88ba134e33d0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.182355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.188239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.188876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.189155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.189421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.233289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 535/1098] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:44:41.239140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.256665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.258129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.286017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.338235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81c4d9-a61d-493d-8bd9-ed27070a896a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.355636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 564/1099] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:44:41.361465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.373147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.373770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.374044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.374311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.375401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.376995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.380360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 536/1100] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:41.385383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.392862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.460605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583aa58b-46f2-4deb-9673-802ca43ede58 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.488881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8a7fd-cac6-47cd-a252-5e9826ae1f5f None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.494984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.496162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.496162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.496162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.504792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.507609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.509094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:44:41.523523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:41.524732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:44:41.525648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:44:41.525648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:44:41.525648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:44:41.525648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 565/1101] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:44:41.530056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.530310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.530656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.530929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.531197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.531912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=87240a320519451bb52d100e67d495b2, user.id=0d276129efdd49609651b55d7c39d21f) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:41.532215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.533651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.539392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 537/1102] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/role_assignments?user.id=0d276129efdd49609651b55d7c39d21f&scope.project.id=87240a320519451bb52d100e67d495b2&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:41.620346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:41.637328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28464d21-32b8-4228-b00d-7042bf3b1fdd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.673216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.673823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.674098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.674365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.675005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:41.675325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.677270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.689950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 566/1103] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:44:41.695915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.801789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b599def-2f3a-4145-be56-6003c2b8fac8 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.834221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.834847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.835123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.835394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:41.841805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:41.843231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:44:41.854705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:44:41.855620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:44:41.856557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 538/1104] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:44:41.861673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:41.963102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6544a1-7623-4215-a753-8d3dbf85f78a None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:41.998570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:41.999174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:41.999454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:41.999729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:42.000447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:42.000755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:42.002178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e053cdf-5f3f-48fb-95ef-09b71cb7cf42 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:42.013900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 567/1105] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:42.020579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:42.061057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:42.120019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40256f5-6ea6-45ed-82a2-bc2960c08784 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:42.152837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:42.153429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:42.153703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:42.153970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:42.154679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] RBAC: Adding query filter params (role.id=2b8df647ad294701ae3b6420f8f1fab8, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=02cff3a52a8e47feb0acc62f084f110a) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:42.154982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:42.156415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf166b1b-72c7-4317-a682-8db78456c413 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:42.162609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 539/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:42 2022] GET /identity/v3/role_assignments?user.id=02cff3a52a8e47feb0acc62f084f110a&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=2b8df647ad294701ae3b6420f8f1fab8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:43.481545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a41b4-0e7d-4534-bfa7-fb6b8f3df0c4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:43.482114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a41b4-0e7d-4534-bfa7-fb6b8f3df0c4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:43.482114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a41b4-0e7d-4534-bfa7-fb6b8f3df0c4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:43.483402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 568/1107] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:43.489346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:43.489746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:43.489926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:43.507783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:43.509005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:43.574748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 540/1108] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:43.845540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a41b4-0e7d-4534-bfa7-fb6b8f3df0c4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:43.850017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:43.945253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a41b4-0e7d-4534-bfa7-fb6b8f3df0c4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:43.977967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:43.978583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:43.978862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:43.979136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:43.980242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:43.981714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771586e3-f562-490e-8c26-57dc77297812 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:43.983278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 569/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:43.989065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:44.019696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:44.085852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50662355-967d-47a1-a4e4-3f03655b0ca4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:44.118371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:44.118972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:44.119245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:44.119515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:44.120151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:44.121603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7250531a-9ff4-44fc-ab63-b82fd35e69f1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:44.142293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 541/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:44:43 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:46.074673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8777222-a38a-459e-bbe3-fd2531c707ee None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:46.075207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8777222-a38a-459e-bbe3-fd2531c707ee None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:46.075207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8777222-a38a-459e-bbe3-fd2531c707ee None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:46.076575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 570/1111] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:46.082335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:46.082754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:46.082885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:46.101167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:46.102349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:46.168024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 542/1112] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:46.437485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8777222-a38a-459e-bbe3-fd2531c707ee None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:46.508366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:46.538054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8777222-a38a-459e-bbe3-fd2531c707ee None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:46.571402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:46.572024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:46.572298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:46.572604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] PATH_INFO: `/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:46.573980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] RBAC: Authorizing `identity:get_role(role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:46.575335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:46.576694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 571/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:46 2022] GET /identity/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:46.582550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:46.600848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:46.681487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2eb49-e591-4399-b492-145f1a10dac5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:46.714040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:46.714670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:46.714945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:46.715217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] PATH_INFO: `/v3/users/1093d587b497440593cb56899cf6ded4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:46.729958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] RBAC: Authorizing `identity:get_user(user_id=1093d587b497440593cb56899cf6ded4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:46.731414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:46.733099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 543/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:46 2022] GET /identity/v3/users/1093d587b497440593cb56899cf6ded4 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:46.739481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:46.840726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b0e1b-79eb-46eb-9f41-0d2647ff196c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:46.873668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:46.874276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:46.874555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:46.874827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:46.885771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:46.941321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:46.942701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:47.037459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 572/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:47.043431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:47.119094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:47.141272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef6503-cefd-4bd8-9c69-6866c1e61958 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:47.174272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:47.174894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:47.175771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:47.176042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:47.177177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:47.178596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabad78-f0e4-46ac-aaec-ff0edf36121d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:47.180207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 544/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:47 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:47.186442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:47.226672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:47.284134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0f4be8-d93e-486f-b284-a1cd3c4accd4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:47.318234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:47.318834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:47.319113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:47.319386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:47.320103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=87240a320519451bb52d100e67d495b2, user.id=1093d587b497440593cb56899cf6ded4) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:47.320431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:47.321863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d0d750-e468-4b8c-b52c-fb3a0781a5c6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:47.327342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 573/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:47 2022] GET /identity/v3/role_assignments?user.id=1093d587b497440593cb56899cf6ded4&scope.project.id=87240a320519451bb52d100e67d495b2&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:49.215434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399f78-33a0-4332-9e13-44793aa68db0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:49.216028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399f78-33a0-4332-9e13-44793aa68db0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:49.216028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa399f78-33a0-4332-9e13-44793aa68db0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:49.217348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 545/1118] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:49.222576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:49.222973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:49.223121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:49.241160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:49.242352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:49.308455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 574/1119] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:49.576908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa399f78-33a0-4332-9e13-44793aa68db0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:49.677210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa399f78-33a0-4332-9e13-44793aa68db0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:49.710102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:49.710720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:49.711001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:49.711276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] PATH_INFO: `/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:49.712678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] RBAC: Authorizing `identity:get_role(role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:49.714052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:49.715366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 546/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:49 2022] GET /identity/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:49.721411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:49.754769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:49.819837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6d5d6-0d7f-4487-9902-fb3e4f8018c9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:49.853206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:49.853761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:49.854042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:49.854315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] PATH_INFO: `/v3/users/1093d587b497440593cb56899cf6ded4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:49.855441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] RBAC: Authorizing `identity:get_user(user_id=1093d587b497440593cb56899cf6ded4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:49.856907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:49.858494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 575/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:49 2022] GET /identity/v3/users/1093d587b497440593cb56899cf6ded4 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:49.864847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:49.880190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:49.962325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd871065-cc9b-46c6-b68b-ba72a9791a4c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:49.995473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:49.996111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:49.996420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:49.996692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:49.997781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:49.999200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f7ac15-2ce4-4c11-975c-e82b67a07cff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:50.000832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 547/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:49 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:50.006754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:50.103688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead2f3d-47d8-4f07-89f8-61a7dd5bb1ff None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:50.105143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:50.138440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:50.139083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:50.139361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:50.139634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2/users/1093d587b497440593cb56899cf6ded4/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:50.141854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] RBAC: Authorizing `identity:create_grant(project_id=87240a320519451bb52d100e67d495b2, user_id=1093d587b497440593cb56899cf6ded4, role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:50.143281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b97dd1-5e44-4c6c-b7ab-b0bd152d8084 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:50.155842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 576/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:44:50 2022] PUT /identity/v3/projects/87240a320519451bb52d100e67d495b2/users/1093d587b497440593cb56899cf6ded4/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:44:52.035051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4805a-0673-4cfc-a9ff-15eed0874147 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:52.035615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4805a-0673-4cfc-a9ff-15eed0874147 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:52.035615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4805a-0673-4cfc-a9ff-15eed0874147 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:52.036945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 548/1124] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:52.042218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:52.042629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:52.042767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:52.060854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:52.062041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:52.126464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 577/1125] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:52.392936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4805a-0673-4cfc-a9ff-15eed0874147 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:52.478712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:52.499914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4805a-0673-4cfc-a9ff-15eed0874147 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:52.536292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:52.536958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:52.537237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:52.537515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] PATH_INFO: `/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:52.538904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] RBAC: Authorizing `identity:get_role(role_id=d2bcddeedf6e4e6a97d00afd306f4fd0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:52.540273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:52.541631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 549/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:52 2022] GET /identity/v3/roles/d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:52.547710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:52.639926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:52.650142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c881cbb-0a77-4691-8ac5-de9497b06bb6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:52.691207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:52.691836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:52.692115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:52.692411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] PATH_INFO: `/v3/users/1093d587b497440593cb56899cf6ded4` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:52.693555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] RBAC: Authorizing `identity:get_user(user_id=1093d587b497440593cb56899cf6ded4)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:52.694984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:52.696607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 578/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:44:52 2022] GET /identity/v3/users/1093d587b497440593cb56899cf6ded4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:52.702569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:52.797578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f64de-c4c1-489f-b828-c93084423c73 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:52.831412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:52.832009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:52.832283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:52.832579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:52.849639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:52.897950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:52.899320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:52.995614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 550/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:44:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:44:53.001595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:53.106175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52ebe4-0405-408f-9549-0cc8ad384e6f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:53.140830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:53.141458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:53.141736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:53.142007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] PATH_INFO: `/v3/projects/87240a320519451bb52d100e67d495b2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:53.143112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] RBAC: Authorizing `identity:get_project(project_id=87240a320519451bb52d100e67d495b2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:53.144563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90829aea-bf46-4b13-8397-47dd7ee179ae None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:53.146193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 579/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:44:53 2022] GET /identity/v3/projects/87240a320519451bb52d100e67d495b2 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:53.153632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:53.203687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:53.258743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc53d-ee98-4200-99b6-c8570c6bb234 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:53.293994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:53.294594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:53.294872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:53.295143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:53.295860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] RBAC: Adding query filter params (role.id=d2bcddeedf6e4e6a97d00afd306f4fd0, scope.project.id=87240a320519451bb52d100e67d495b2, user.id=1093d587b497440593cb56899cf6ded4) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:44:53.296166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:53.297633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a3a4c-6487-420d-af59-c5f721efab5b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:53.303483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 551/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:44:53 2022] GET /identity/v3/role_assignments?user.id=1093d587b497440593cb56899cf6ded4&scope.project.id=87240a320519451bb52d100e67d495b2&role.id=d2bcddeedf6e4e6a97d00afd306f4fd0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:55.216132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805e3-cc35-4be6-8c70-839f71f5f916 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:55.216711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805e3-cc35-4be6-8c70-839f71f5f916 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:55.216711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2805e3-cc35-4be6-8c70-839f71f5f916 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:55.218024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 580/1131] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:55.223359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:55.223801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:55.223904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:55.241783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:55.242965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:55.307448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 552/1132] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:55.575649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2805e3-cc35-4be6-8c70-839f71f5f916 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:55.605368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:55.681453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2805e3-cc35-4be6-8c70-839f71f5f916 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:55.713816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:55.714424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:55.714700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:55.714970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:55.716061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:55.717517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c251d-870e-4739-9070-41a2449fe582 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:55.719089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 581/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:55.725038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:55.767041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:55.826495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4786d-d597-492c-b623-aab7595ebd36 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:55.858388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:55.858985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:55.859260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:55.859531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:55.860172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:55.861752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191742f3-784e-41dc-bd10-ce3667c7700c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:55.888920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 553/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:44:55 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:44:57.823209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c1e0-8a10-4fa8-bdda-9cf0f1527ef8 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:57.823765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c1e0-8a10-4fa8-bdda-9cf0f1527ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:57.823765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375c1e0-8a10-4fa8-bdda-9cf0f1527ef8 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:57.825106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 582/1135] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:44:57.830424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:57.831310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:57.831507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:57.849787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:44:57.850979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:44:57.915925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 554/1136] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:44:58.187422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c1e0-8a10-4fa8-bdda-9cf0f1527ef8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:58.279823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:58.287567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375c1e0-8a10-4fa8-bdda-9cf0f1527ef8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:58.320858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:58.321473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:58.321748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:58.322018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:58.323105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:58.324553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d5baf-4bd4-40b8-b19c-5bfc6d73599e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:58.326113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 583/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:44:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:44:58.332099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:44:58.356423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:44:58.431994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8239bd-aee6-4bed-a2db-1cdeaa970400 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:44:58.465089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:44:58.465620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:44:58.465897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:44:58.466168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:44:58.466806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:44:58.468236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb17027-8e49-41ae-a06b-51e2b4dcea13 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:44:58.490422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 555/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:44:58 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:45:00.430481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0481-46c3-43d9-a925-243e2a42bd06 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:00.430993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0481-46c3-43d9-a925-243e2a42bd06 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:00.430993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f0481-46c3-43d9-a925-243e2a42bd06 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:00.432349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 584/1139] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:00.437704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:00.438217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:00.438312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:00.456511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:00.457702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:00.532130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 556/1140] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:00.808547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f0481-46c3-43d9-a925-243e2a42bd06 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:00.910906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f0481-46c3-43d9-a925-243e2a42bd06 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:00.943039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:00.943659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:00.943938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:00.944216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:00.954908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:00.960074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:00.961279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:00.962576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 585/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:00.967318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:00.979352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:01.068440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0cf89-d3b8-4139-a8c0-4a89d28677e0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:01.102535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:01.103137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:01.103409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:01.103677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:01.104335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:01.104663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:01.106015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:01.113789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 557/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:01.120053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:01.145275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:01.221052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fb486-1f7e-445b-9b5a-e214636c83fb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:01.255763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:01.256413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:01.256692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:01.256964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] PATH_INFO: `/v3/users/4f2a85ee0d4e4e089e359859f20591e5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:01.275164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] RBAC: Authorizing `identity:get_user(user_id=4f2a85ee0d4e4e089e359859f20591e5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:01.276639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:01.278295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 586/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:01 2022] GET /identity/v3/users/4f2a85ee0d4e4e089e359859f20591e5 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:01.284661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:01.373116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:01.404952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1cf95-bb56-417e-98b8-bacc15258a1a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:01.453369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:01.454053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:01.454231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:01.454500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:01.531730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:01.533211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:01.606391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:01.641231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 558/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:45:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:45:01.649285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:01.739108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:01.758025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381215eb-643b-4b8d-a296-3686b204c226 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:01.792176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:01.792831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:01.793206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:01.793481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] PATH_INFO: `/v3/projects/6e0d5918250f4a04bf148886f2b66cda` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:01.794612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] RBAC: Authorizing `identity:get_project(project_id=6e0d5918250f4a04bf148886f2b66cda)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:01.796045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52084b3-bd69-4ac5-bdb1-4ce607661445 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:01.797729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 587/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:01 2022] GET /identity/v3/projects/6e0d5918250f4a04bf148886f2b66cda => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:01.804505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:01.910725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a14c48e-57db-4b42-8d77-cec66a56c939 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:01.949110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:01.949713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:01.949990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:01.950259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:01.950974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=6e0d5918250f4a04bf148886f2b66cda, user.id=4f2a85ee0d4e4e089e359859f20591e5) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:01.951276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:01.952713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b340a1-0dcc-4e1b-ba69-e10b8c50f9f5 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:01.958070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 559/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:45:01 2022] GET /identity/v3/role_assignments?user.id=4f2a85ee0d4e4e089e359859f20591e5&scope.project.id=6e0d5918250f4a04bf148886f2b66cda&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:03.821371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939164a-ca35-4198-8e5f-aa6858117796 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:03.821901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939164a-ca35-4198-8e5f-aa6858117796 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:03.821901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939164a-ca35-4198-8e5f-aa6858117796 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:03.823237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 588/1147] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:03.828492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:03.829019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:03.829019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:03.846702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:03.847897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:03.876400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:03.915031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 560/1148] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:04.185205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939164a-ca35-4198-8e5f-aa6858117796 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:04.284188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939164a-ca35-4198-8e5f-aa6858117796 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:04.317384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:04.318090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:04.318362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:04.318633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:04.328381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:04.333137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:04.334272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:04.335390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 589/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:04.340303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:04.438407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f0194-cbe7-49b0-b11d-3081ce0b5cb8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:04.470647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:04.471759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:04.472029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:04.472293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:04.472965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:04.473261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:04.474611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:04.482415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 561/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:04.488932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:04.501729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:04.586141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a6983-4281-4978-adc1-7d6d657a2fb4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:04.619476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:04.620091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:04.620369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:04.620668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] PATH_INFO: `/v3/users/4f2a85ee0d4e4e089e359859f20591e5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:04.621791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] RBAC: Authorizing `identity:get_user(user_id=4f2a85ee0d4e4e089e359859f20591e5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:04.623213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:04.624828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 590/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:04 2022] GET /identity/v3/users/4f2a85ee0d4e4e089e359859f20591e5 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:04.630616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:04.660026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:04.734240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe1845-2e00-4b1c-8d96-79a40c73c661 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:04.768844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:04.769470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:04.769752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:04.770019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] PATH_INFO: `/v3/projects/6e0d5918250f4a04bf148886f2b66cda` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:04.771121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] RBAC: Authorizing `identity:get_project(project_id=6e0d5918250f4a04bf148886f2b66cda)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:04.772669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e906f24b-c9e1-4cc8-9b96-30b07fe75935 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:04.774330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 562/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:04 2022] GET /identity/v3/projects/6e0d5918250f4a04bf148886f2b66cda => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:04.780511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:04.861225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:04.882321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0593c-e052-4bba-945d-7dde2c89303e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:04.915646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:04.916294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:04.916592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:04.916866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] PATH_INFO: `/v3/projects/6e0d5918250f4a04bf148886f2b66cda/users/4f2a85ee0d4e4e089e359859f20591e5/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:04.918712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] RBAC: Authorizing `identity:create_grant(project_id=6e0d5918250f4a04bf148886f2b66cda, user_id=4f2a85ee0d4e4e089e359859f20591e5, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:04.920129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa297117-3940-4829-945d-f8cb63aae49a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:04.933589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 591/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:45:04 2022] PUT /identity/v3/projects/6e0d5918250f4a04bf148886f2b66cda/users/4f2a85ee0d4e4e089e359859f20591e5/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:45:06.804059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc91a-82c5-44fa-9831-0205822f50c0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:06.804624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc91a-82c5-44fa-9831-0205822f50c0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:06.804624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537dc91a-82c5-44fa-9831-0205822f50c0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:06.805956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 563/1154] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:06.811286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832341-12c2-4f60-b688-468edf61594e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:06.811725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832341-12c2-4f60-b688-468edf61594e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:06.811817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db832341-12c2-4f60-b688-468edf61594e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:06.830098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-db832341-12c2-4f60-b688-468edf61594e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:06.831284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db832341-12c2-4f60-b688-468edf61594e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:06.896648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 592/1155] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:07.162900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dc91a-82c5-44fa-9831-0205822f50c0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:07.259040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:07.265962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537dc91a-82c5-44fa-9831-0205822f50c0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:07.299371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:07.299989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:07.300262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:07.300688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:07.311297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:07.315947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:07.317067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:45:07.318127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 564/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:07.323273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832341-12c2-4f60-b688-468edf61594e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:07.390184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:07.425791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db832341-12c2-4f60-b688-468edf61594e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:07.458886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:07.459474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:07.459754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:07.460028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:07.460715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:07.461019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:07.462378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:07.470296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 593/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:07.476951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:07.616315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98218d-1e4c-4ecb-85fc-e17a69359188 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:07.649184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:07.649818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:07.650096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:07.650366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] PATH_INFO: `/v3/users/4f2a85ee0d4e4e089e359859f20591e5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:07.651480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] RBAC: Authorizing `identity:get_user(user_id=4f2a85ee0d4e4e089e359859f20591e5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:07.652955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:07.654710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 565/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:07 2022] GET /identity/v3/users/4f2a85ee0d4e4e089e359859f20591e5 => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:07.662425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:07.762607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5219b64-003c-4175-8d9b-0eed1a30ffc6 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:07.790813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:07.797189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:07.797797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:07.798081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:07.798357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:07.864032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:07.865786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:07.962425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 594/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:45:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:45:07.968613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:07.994339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:08.070532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b78151-15d2-402c-a49d-e82dfe02c341 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:08.104485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:08.105117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:08.105395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:08.105668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] PATH_INFO: `/v3/projects/6e0d5918250f4a04bf148886f2b66cda` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:08.106765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] RBAC: Authorizing `identity:get_project(project_id=6e0d5918250f4a04bf148886f2b66cda)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:08.108202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dc479-8a51-4d13-8db5-af1a0cc435c0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:08.109878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 566/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:07 2022] GET /identity/v3/projects/6e0d5918250f4a04bf148886f2b66cda => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:08.116363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:08.146150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:08.213957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c58c-004c-436a-838d-8b962f236179 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:08.248180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452025-3806-4114-98a4-e590f435094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:08.248807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452025-3806-4114-98a4-e590f435094b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:08.249084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452025-3806-4114-98a4-e590f435094b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:08.249356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452025-3806-4114-98a4-e590f435094b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:08.250073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452025-3806-4114-98a4-e590f435094b None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=6e0d5918250f4a04bf148886f2b66cda, user.id=4f2a85ee0d4e4e089e359859f20591e5) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:08.250379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452025-3806-4114-98a4-e590f435094b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:08.252318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452025-3806-4114-98a4-e590f435094b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:08.258026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 595/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:45:08 2022] GET /identity/v3/role_assignments?user.id=4f2a85ee0d4e4e089e359859f20591e5&scope.project.id=6e0d5918250f4a04bf148886f2b66cda&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:10.185690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8791-af3e-4cc1-8997-1bcf3f7ebea2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:10.186216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8791-af3e-4cc1-8997-1bcf3f7ebea2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:10.186216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f8791-af3e-4cc1-8997-1bcf3f7ebea2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:10.187566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 567/1162] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:10.192891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:10.193289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:10.193445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:10.211226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:10.212453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:10.276789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 596/1163] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:10.547237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f8791-af3e-4cc1-8997-1bcf3f7ebea2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:10.637680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:10.648728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f8791-af3e-4cc1-8997-1bcf3f7ebea2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:10.681354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:10.681958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:10.682234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:10.682505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:10.747373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:10.749113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:10.834683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:10.844072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 568/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:45:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:45:10.850622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:10.874979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:10.947553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5ea2e0-401c-4f04-824a-f15557f6e773 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:10.981164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:10.981784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:10.982062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:10.982333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:10.988883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:10.990579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-70acf88d-ed4d-4148-ba76-7f6d4e262c6f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:11.001984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:11.003177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:11.004050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 597/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:45:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:11.009178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:11.105482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebaec74-9325-41ae-880d-8ff2f4108adb None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:11.138751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:11.139358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:11.139635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:11.139907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:11.140565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:11.140863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:11.142780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39c8d33-e3ea-4f3d-87a4-8ee647d24c9e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:11.149752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 569/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu Aug 25 02:45:11 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:13.025728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901f8e-c478-4b7e-be43-64b383c00a9f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:13.026285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901f8e-c478-4b7e-be43-64b383c00a9f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:13.026285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64901f8e-c478-4b7e-be43-64b383c00a9f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:13.027594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 598/1167] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:13.033515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d5fb-2e9a-4b41-b692-1ea705cd1d5c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:13.033934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d5fb-2e9a-4b41-b692-1ea705cd1d5c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:13.034072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081d5fb-2e9a-4b41-b692-1ea705cd1d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:13.051921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a081d5fb-2e9a-4b41-b692-1ea705cd1d5c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:13.053150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a081d5fb-2e9a-4b41-b692-1ea705cd1d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:13.102306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:13.119306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 570/1168] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:13.390114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64901f8e-c478-4b7e-be43-64b383c00a9f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:13.474819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:13.491532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64901f8e-c478-4b7e-be43-64b383c00a9f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:13.524701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:13.525298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:13.525577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:13.525851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:13.526499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:13.527867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a8352-7648-4732-a6fe-eb629e351fc2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:13.543108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 599/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu Aug 25 02:45:13 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:45:15.457806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299ca7-ba37-4c6f-ba87-4e684ecad6c2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:15.458317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299ca7-ba37-4c6f-ba87-4e684ecad6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:15.458435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12299ca7-ba37-4c6f-ba87-4e684ecad6c2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:15.459706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 571/1170] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:15.464884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:15.465255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:15.465443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:15.483664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:15.484884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:15.549801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 600/1171] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:15.822233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299ca7-ba37-4c6f-ba87-4e684ecad6c2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:15.919935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12299ca7-ba37-4c6f-ba87-4e684ecad6c2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:15.951811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:15.952448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:15.952728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:15.953000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] PATH_INFO: `/v3/domains/9e0c81d3b3774c0ea84e46f8d1a95dbb` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:15.963540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e0c81d3b3774c0ea84e46f8d1a95dbb)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:15.965004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60426a-9544-44bf-8b69-119809791b93 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:15.966573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 572/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Aug 25 02:45:15 2022] GET /identity/v3/domains/9e0c81d3b3774c0ea84e46f8d1a95dbb => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:15.973034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:16.043729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:16.067596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41eafc-0836-418d-8a4b-4227e61affd1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:16.100566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:16.101096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:16.101374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:16.101644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:16.102277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:16.103695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123967a-2770-4df0-99cd-169bc795b727 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:16.128976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 601/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:45:15 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:45:18.055880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e2b5d-59d6-425a-9a60-09f1acb6b4f1 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:18.056454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e2b5d-59d6-425a-9a60-09f1acb6b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:18.056454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e2b5d-59d6-425a-9a60-09f1acb6b4f1 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:18.057795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 573/1174] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:18.063121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:18.063588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:18.064258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:18.081990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:18.083177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:18.147570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 602/1175] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:18.417608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e2b5d-59d6-425a-9a60-09f1acb6b4f1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:18.463919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:18.518250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e2b5d-59d6-425a-9a60-09f1acb6b4f1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:18.553077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:18.553707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:18.553985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:18.554260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] PATH_INFO: `/v3/domains/9e0c81d3b3774c0ea84e46f8d1a95dbb` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:18.555392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e0c81d3b3774c0ea84e46f8d1a95dbb)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:18.556881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da653a26-f0c0-48af-8b39-aec6cca822b1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:18.558445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 574/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu Aug 25 02:45:18 2022] GET /identity/v3/domains/9e0c81d3b3774c0ea84e46f8d1a95dbb => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:18.564220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:18.618603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:18.662099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd44ccf-f69a-4ba0-b61b-1d50cd5cc116 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:18.694542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:18.695142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:18.695424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:18.695695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:18.696340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:18.697831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84e0fb4-896e-4ae6-93bb-d26aade65b43 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:18.717878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 603/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:45:18 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:45:20.646748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22c2b-5124-4b21-ae21-e24ba494962f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:20.647269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22c2b-5124-4b21-ae21-e24ba494962f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:20.647269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb22c2b-5124-4b21-ae21-e24ba494962f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:20.648574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 575/1178] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:20.653790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:20.654170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:20.654325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:20.672527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:20.674320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:20.738171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 604/1179] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:21.007704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22c2b-5124-4b21-ae21-e24ba494962f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.106122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb22c2b-5124-4b21-ae21-e24ba494962f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:21.119281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:21.138594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:21.139214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:21.139492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:21.139765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:21.150657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:21.155219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:21.156431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:45:21.158166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 576/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:21.163075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.203160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:21.259301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88823df2-92b3-4bc4-981d-80d1af97a043 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:21.292087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:21.292710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:21.292991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:21.293260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:21.293907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:21.294207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:21.295556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:21.303662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 605/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:21.309554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.406775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336a24e4-0d0e-4151-ae2f-6d90af6a6b3e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:21.440301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:21.440947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:21.441226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:21.441498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] PATH_INFO: `/v3/users/e6993071e11a4318a3bc0ba5e2034307` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:21.454571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] RBAC: Authorizing `identity:get_user(user_id=e6993071e11a4318a3bc0ba5e2034307)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:21.456004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:21.457614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 577/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/users/e6993071e11a4318a3bc0ba5e2034307 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:21.463520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.559344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c0ef6-487b-4783-95c0-ac60da8a8c6b None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:21.561527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:21.592595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:21.593188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:21.593467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:21.593761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:21.658086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:21.659514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:21.754749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 606/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:45:21.760782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.791796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:21.857556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fb111-19b4-4a7e-b44b-7696e53d9621 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:21.889746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:21.890356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:21.890633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:21.890975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] PATH_INFO: `/v3/projects/d563bab9a2ab467f947cea1779ed6978` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:21.892623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] RBAC: Authorizing `identity:get_project(project_id=d563bab9a2ab467f947cea1779ed6978)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:21.894043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7939f-1f1d-4e52-b4f4-7e9cc166bb3f None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:21.895634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 578/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/projects/d563bab9a2ab467f947cea1779ed6978 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:21.901715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:21.904835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:21.997513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d38e20-657c-4423-81ef-55a175f6f5d2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:22.029819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:22.030408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:22.030687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:22.030957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:22.031665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=d563bab9a2ab467f947cea1779ed6978, user.id=e6993071e11a4318a3bc0ba5e2034307) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:22.031967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:22.034084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf7b8db-467f-4a3e-b538-2f8b9a49e7e1 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:22.039270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 607/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:45:21 2022] GET /identity/v3/role_assignments?user.id=e6993071e11a4318a3bc0ba5e2034307&scope.project.id=d563bab9a2ab467f947cea1779ed6978&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:23.906704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7df54-d9ac-4ffe-9d72-e01865f250da None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:23.907262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7df54-d9ac-4ffe-9d72-e01865f250da None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:23.907262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7df54-d9ac-4ffe-9d72-e01865f250da None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:23.908636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 579/1186] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:23.913799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:23.914197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:23.914353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:23.931998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:23.933219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:23.992298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:23.998290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 608/1187] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:24.268821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7df54-d9ac-4ffe-9d72-e01865f250da None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:24.365056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:24.369140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7df54-d9ac-4ffe-9d72-e01865f250da None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:24.402591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:24.403213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:24.403495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:24.403776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:24.414150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:24.418770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:24.419860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:45:24.420833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 580/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:24.426462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:24.521924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aad15-1186-4718-8ca3-9b2977f3ca1d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:24.555299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:24.555897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:24.556173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:24.556466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:24.557118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:24.557415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:24.558764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:24.566688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 609/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:24.572694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:24.671092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bde04-a6f3-400e-b2c9-dce27814e769 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:24.703414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:24.704052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:24.704328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:24.704627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] PATH_INFO: `/v3/users/e6993071e11a4318a3bc0ba5e2034307` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:24.705741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] RBAC: Authorizing `identity:get_user(user_id=e6993071e11a4318a3bc0ba5e2034307)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:24.707156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:24.708744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 581/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:24 2022] GET /identity/v3/users/e6993071e11a4318a3bc0ba5e2034307 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:24.714532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:24.773482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:24.813119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38a72a-9e9b-48ba-a02e-1ca21599ce79 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:24.846751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:24.847364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:24.847642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:24.847912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] PATH_INFO: `/v3/projects/d563bab9a2ab467f947cea1779ed6978` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:24.849124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] RBAC: Authorizing `identity:get_project(project_id=d563bab9a2ab467f947cea1779ed6978)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:24.850548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef23792-ae53-428e-8cab-f75a9f9821c0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:24.852165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 610/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:24 2022] GET /identity/v3/projects/d563bab9a2ab467f947cea1779ed6978 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:24.858157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:24.886185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:24.957538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5bd0f9-86c7-4021-b61b-59972592306d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:24.990452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:24.991091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:24.991366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:24.991635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] PATH_INFO: `/v3/projects/d563bab9a2ab467f947cea1779ed6978/users/e6993071e11a4318a3bc0ba5e2034307/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:24.993506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] RBAC: Authorizing `identity:create_grant(project_id=d563bab9a2ab467f947cea1779ed6978, user_id=e6993071e11a4318a3bc0ba5e2034307, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:24.994916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c20d51-74da-492c-a0f0-39dac4578170 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:25.007150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 582/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:45:24 2022] PUT /identity/v3/projects/d563bab9a2ab467f947cea1779ed6978/users/e6993071e11a4318a3bc0ba5e2034307/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:45:26.860904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a518-d35d-4c18-af1e-c6bb1788cab4 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:26.861477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a518-d35d-4c18-af1e-c6bb1788cab4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:26.861477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e473a518-d35d-4c18-af1e-c6bb1788cab4 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:26.862769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 611/1193] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:45:26.868279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:26.868746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:26.868852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:26.886857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:45:26.888042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:45:26.953034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 583/1194] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:45:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:45:27.219370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473a518-d35d-4c18-af1e-c6bb1788cab4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:27.318349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e473a518-d35d-4c18-af1e-c6bb1788cab4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:27.342747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:27.350313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:27.350928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:27.351202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:27.351467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:27.361694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:45:27.366537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:45:27.367637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:45:27.368670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 612/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:45:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:45:27.373745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:27.392636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:27.470874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a51b58-92be-4f31-8d24-c61f2a36b009 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:27.504354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:27.504978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:27.505252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:27.505521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:27.506172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:27.506469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:27.507823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:27.515501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 584/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:45:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:27.521345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:27.616796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74eafa-ac70-44ff-add6-500d580836b5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:27.648412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:27.649044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:27.649321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:27.649591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] PATH_INFO: `/v3/users/e6993071e11a4318a3bc0ba5e2034307` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:27.650713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] RBAC: Authorizing `identity:get_user(user_id=e6993071e11a4318a3bc0ba5e2034307)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:27.652140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:27.653737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 613/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu Aug 25 02:45:27 2022] GET /identity/v3/users/e6993071e11a4318a3bc0ba5e2034307 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:27.660237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:27.738664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:27.757363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af51437-2623-42e5-8a7e-e440561361a3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:27.791292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:27.791856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:27.792134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:27.792427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:27.857514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:27.858958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:27.935148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:27.954733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 585/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:45:27.960762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:28.015033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:28.056827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e3360-155f-4255-828d-3d1ef3c9b413 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:28.089158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:28.089769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:28.090046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:28.090318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] PATH_INFO: `/v3/projects/d563bab9a2ab467f947cea1779ed6978` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:28.091403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] RBAC: Authorizing `identity:get_project(project_id=d563bab9a2ab467f947cea1779ed6978)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:28.092848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09efb369-aead-4633-a18c-78c4cc6e0eab None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:28.095023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 614/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu Aug 25 02:45:27 2022] GET /identity/v3/projects/d563bab9a2ab467f947cea1779ed6978 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:28.101122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:45:28.195785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98f6de-a5cb-4194-9ee4-71c4ae5ff0ff None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:45:28.228120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:45:28.228733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:45:28.229014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:45:28.229286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:45:28.229990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=d563bab9a2ab467f947cea1779ed6978, user.id=e6993071e11a4318a3bc0ba5e2034307) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:45:28.230292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:45:28.231709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b553a2-fc16-4863-a1d4-86efb5ba33be None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:45:28.237276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 586/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:45:28 2022] GET /identity/v3/role_assignments?user.id=e6993071e11a4318a3bc0ba5e2034307&scope.project.id=d563bab9a2ab467f947cea1779ed6978&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:45:38.085097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=38 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:45:38.234742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=78 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:23.632010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0c80-6831-4cc9-bbd3-0338f9524578 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:23.632010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0c80-6831-4cc9-bbd3-0338f9524578 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:23.632010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d0c80-6831-4cc9-bbd3-0338f9524578 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:23.634839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 615/1201] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:23.640934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:23.641420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:23.641601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:23.680459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:23.680459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:23.773381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 587/1202] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:24.104858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0c80-6831-4cc9-bbd3-0338f9524578 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:24.256265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d0c80-6831-4cc9-bbd3-0338f9524578 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:24.298267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:24.298999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:24.299404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:24.299683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:24.315061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:24.316844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:24.335484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:24.336878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:24.338070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:24.338070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:24.338070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:24.338070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 616/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:24.345014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:24.488855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acbee-1fe9-4e9d-a34b-7484bf10ead2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:24.526301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:24.534955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:24.535644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:24.536035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:24.536350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:24.537162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:24.537574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:24.539253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa5d10-ca4c-4f49-916a-5820a7ebbea9 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:24.564550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 588/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:24.566353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:24.632412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:24.695219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaac877-21f2-4bb6-97ce-f7de5c3a08ff None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:24.736315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:24.737223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:24.737502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:24.737820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:24.738451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:24.740051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16646c-aad3-4665-a30e-479fadb650c2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:24.765604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 617/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu Aug 25 02:46:24 2022] POST /identity/v3/users => generated 251 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:26.883791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd4b5-8161-42dd-895d-577d18e38c28 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:26.884350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd4b5-8161-42dd-895d-577d18e38c28 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:26.884350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd4b5-8161-42dd-895d-577d18e38c28 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:26.885721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 589/1206] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:26.892361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:26.892857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:26.893043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:26.914125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:26.915363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:26.998616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 618/1207] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:27.301632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd4b5-8161-42dd-895d-577d18e38c28 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:27.437979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cd4b5-8161-42dd-895d-577d18e38c28 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:27.489005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:27.490012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:27.490460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:27.490886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:27.509869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:27.514676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:27.515740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:27.516861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 590/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:27.522703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:27.578531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:27.655686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ac406-a38e-4d17-b5d6-f685c4cad9ed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:27.698539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:27.699398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:27.699608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:27.699842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:27.700704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:27.701022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:27.702611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:27.713322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 619/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:27.720298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:27.786284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:27.852970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb561d-de38-44d3-b23f-cb20f6dc1e79 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:27.894563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:27.895251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:27.895446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:27.895693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:27.911126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:27.912627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:27.930446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:27.931593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:27.938321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:27.938321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:27.938321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:27.938321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 591/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:27.938570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:28.045341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:28.049360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399ec0-84af-426f-8d85-13b83f959c24 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:28.086087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:28.086700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:28.086976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:28.087247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:28.087885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:28.088185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:28.089586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:28.102192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 620/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:28.108716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:28.217884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f801308-b56d-463a-861c-f70e00fd2c87 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:28.219980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:28.256606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:28.257240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:28.257546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:28.257791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:28.265942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:28.267401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:28.280935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:28.283088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:28.284287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 592/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:28.288137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:28.402707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816eee4-766a-43c7-9b45-899db8a83a4e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:28.448277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:28.449054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:28.449335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:28.449646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:28.450537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:28.450867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:28.452368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:28.473206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 621/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:28.479204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:28.599116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533eab1e-fdbe-4444-b14f-b526de49debd None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:28.642495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:28.643098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:28.643468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:28.643814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:28.687119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:28.743919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:28.745822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:28.884434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 593/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:46:28.886463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:28.907375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:28.999471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaba7fe-a5f9-423c-b1cc-15442c857729 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:29.036107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:29.037164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:29.037678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:29.038148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:29.052514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:29.055069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:29.084425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:29.086407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:29.087826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:29.087826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:29.087826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:29.094572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 622/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:29.096457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:29.167797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:29.212068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7b750e-9700-4e2e-aff8-bc181a26e4c0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:29.253777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:29.254404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:29.254715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:29.254959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:29.255700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:29.256022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:29.257623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:29.271749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 594/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:29.277139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:29.358896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:29.397095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddd69f3-b2f2-4c12-8167-0f92c2236a73 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:29.438313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:29.438869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:29.439147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:29.439418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:29.446395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:29.447841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:29.459708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:29.460700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:29.466874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 623/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:29.467487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:29.630206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3394d12-bf61-4e60-b544-7f5ca7efcca1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:29.663840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:29.680019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:29.680766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:29.681111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:29.681464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:29.682779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:29.683628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:29.685026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae1bf8-9eec-4ce4-98d4-47e82e5d8c65 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:29.699109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 595/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:29.708697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:29.858063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96926e-f3ae-4548-afe1-e072f36454de None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:29.893425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:29.900000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:29.900616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:29.900896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:29.901171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:29.901907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=51e6b673144045b5baffab410e261706) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:29.902231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:29.904213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcf251-3493-439e-a65d-3fd74d8ce191 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:29.913212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 624/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:29 2022] GET /identity/v3/role_assignments?user.id=51e6b673144045b5baffab410e261706&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:31.864876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d82f-1a56-4ade-9d91-bb4418e710a7 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:31.865443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d82f-1a56-4ade-9d91-bb4418e710a7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:31.865443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda3d82f-1a56-4ade-9d91-bb4418e710a7 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:31.866768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 596/1220] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:31.872980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:31.873608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:31.873608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:31.893030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:31.894386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:31.968927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 625/1221] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:32.250714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d82f-1a56-4ade-9d91-bb4418e710a7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:32.359660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda3d82f-1a56-4ade-9d91-bb4418e710a7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:32.400206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:32.403623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:32.403623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:32.403623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:32.417578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:32.423697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:32.424802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:32.426308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 597/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:46:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:32.431690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:32.535675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d70a-4ac4-468f-9dec-4fc602126162 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:32.560540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:32.570944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:32.571546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:32.571819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:32.572092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:32.572788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] RBAC: Adding query filter params (name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:32.573087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:32.574433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:32.582665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 626/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:46:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:32.588442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:32.633978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:32.701122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc167e1-945c-4712-b6d8-543d50484cd2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:32.739071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:32.739753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:32.740030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:32.740295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:32.755078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:32.756553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:32.782864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:32.784064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:32.785231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:32.785231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:32.785231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:32.790372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 598/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:32.790517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:32.898040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae9c6b5-f5a7-470a-bbce-8b9fbae58e3c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:32.933139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:32.933747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:32.935169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:32.935169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:32.935169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:32.935434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:32.936630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:32.950250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 627/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:32.955781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.057245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:33.062610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4748e64-1b34-47a9-b9b3-00075eecd95c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:33.101105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:33.101867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:33.102181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:33.102463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:33.111353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:33.113472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:33.125572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:33.126768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:33.127726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 599/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:33.132730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.189445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:33.250036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777205a-10a7-4e75-896a-439b58ae76f7 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:33.285061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:33.285724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:33.286066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:33.286195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:33.286903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:33.287204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:33.288653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:33.307435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 628/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:33.313205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.430122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637c357-4f81-4d6a-bf3b-4c8c61db226a None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:33.467262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:33.467999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:33.468281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:33.468611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:33.480602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:33.482080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:33.497577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:33.498937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:33.500063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:33.500063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:33.500063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:33.500063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 600/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:33.505896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.612459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b781fdaa-35af-4ece-9ebb-ba32ae856b90 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:33.615120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:33.652853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:33.653531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:33.653780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:33.654046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:33.654678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:33.654976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:33.656355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:33.667725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 629/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:33.673337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.682799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:33.788892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ba8b47-aae1-4564-b5ef-45ab6d9d7dab None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:33.827241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:33.827876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:33.828156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:33.828455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:33.835177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:33.836863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:33.849020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:33.850448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:33.851895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 601/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:33.857675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:33.968331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d4a70-e78e-40ec-904b-998e4403e8dd None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:34.003851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:34.004498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:34.004779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:34.005053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:34.005743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:34.006047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:34.007475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b00b5ed-61d2-446a-b152-d25699caa882 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:34.020113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 630/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:34.026643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:34.096907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:34.140686 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111dd95-ccba-4cb5-9775-6bb1297d8404 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:34.180633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:34.181465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:34.181814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:34.182155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/51e6b673144045b5baffab410e261706/roles/b346fc2f40ba4454bcc8099c5e343a4b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:34.198487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=51e6b673144045b5baffab410e261706, role_id=b346fc2f40ba4454bcc8099c5e343a4b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:34.200050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c30d2b-dc8e-4cb1-8016-ad3946321f95 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:34.213076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 602/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:46:34 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/51e6b673144045b5baffab410e261706/roles/b346fc2f40ba4454bcc8099c5e343a4b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:46:36.156491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab216d-b87a-46ff-a1b0-ec6282a7914a None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:36.157086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab216d-b87a-46ff-a1b0-ec6282a7914a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:36.157086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dab216d-b87a-46ff-a1b0-ec6282a7914a None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:36.158365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 631/1233] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:36.163722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:36.164177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:36.164282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:36.187958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:36.189385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:36.268421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 603/1234] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:36.561447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab216d-b87a-46ff-a1b0-ec6282a7914a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:36.593119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:36.679137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dab216d-b87a-46ff-a1b0-ec6282a7914a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:36.716629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:36.717422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:36.717582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:36.717850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:36.730141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:36.736920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:36.737937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:36.738814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 632/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu Aug 25 02:46:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:36.744458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:36.810157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:36.872866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3334d-86aa-42f9-bcf5-974e87c3f65b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:36.908245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:36.908870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:36.909146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:36.909416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:36.910066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] RBAC: Adding query filter params (name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:36.910400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:36.911725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:36.920106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 604/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu Aug 25 02:46:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:36.925701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:37.020579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:37.039190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5407529-fe59-4aa2-87fe-f7c24f2830c5 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:37.077472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:37.078368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.078817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.079086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.094639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:37.096521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:37.115168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:37.116780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:37.118362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:37.118362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:37.118362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:37.118362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 633/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:37.123358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:37.253389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34474095-8276-4cfd-b8a1-61f649ff7607 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:37.264587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:37.295307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:37.295998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.296280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.296574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.297212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:37.297512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:37.298941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:37.311439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 605/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:37.317331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:37.427220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9298e-7967-4fbb-bb34-732b601e2244 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:37.467293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:37.468175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.468545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.469060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.472086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:37.477575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:37.479452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:37.492223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:37.494884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:37.495837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:37.497443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 634/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:37.501206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:37.617248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3081b-994f-4479-950a-47e2f0323dd3 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:37.653323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:37.653827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.654103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.654372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.655139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:37.655429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:37.656943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:37.676078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 606/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:37.682235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:37.801537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fecdf2-8d69-4cf2-985e-6d207f152e37 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:37.840028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:37.840708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.841062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.841345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.908495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:37.915548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:37.917091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.026486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 635/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:46:38.033222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.066697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:38.150511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11be0e9c-d42b-4a8e-802b-8616efb50c08 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.187254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.187884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.188159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.188457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.199004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.200589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:38.217053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:38.218224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:38.219240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:38.219240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:38.219240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:38.219240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 607/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:38.224194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.327628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:38.333631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef89c-c7ba-40d0-a90c-22a61fa57922 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.374597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.375238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.375518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.375790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.376491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:38.376800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.378171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.391982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 636/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:38.397211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.480666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:38.506708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbbf5a0-5def-46dc-b6d2-047837f36d0c None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.547825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.548617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.548903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.549180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.557406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.559323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:38.572601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:38.573668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:38.575640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 608/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:38.580511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.688059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597f8b-fee9-4edb-831a-bd6d26f50d98 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.727355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.728187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.728598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.728947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.729948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:38.730346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.732029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62856dd8-164a-43a4-acff-7211bd72c662 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.749060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 637/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:38.753052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.875185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c5ac1b-352a-4a4c-ade7-a3fc370e04bc None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.912764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.913445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.913662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.913969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.914741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] RBAC: Adding query filter params (role.id=b346fc2f40ba4454bcc8099c5e343a4b, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=51e6b673144045b5baffab410e261706) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:38.915125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.916807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ee2a5-6ef2-4da3-814a-195ecdff6f49 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.929658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 609/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/role_assignments?user.id=51e6b673144045b5baffab410e261706&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=b346fc2f40ba4454bcc8099c5e343a4b => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:41.143473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b665-ab21-400a-8b8a-a695aa827a35 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.144068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b665-ab21-400a-8b8a-a695aa827a35 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.144068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5b665-ab21-400a-8b8a-a695aa827a35 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.145399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 638/1247] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:41.151000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.151568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.151568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.159787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.173709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:41.174956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:41.249726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 610/1248] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:46:41.520299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b665-ab21-400a-8b8a-a695aa827a35 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.542672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.657784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5b665-ab21-400a-8b8a-a695aa827a35 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.696884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.697587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.697950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.698276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.710569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:41.716278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:41.717572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:41.718827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 639/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:41.724042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.844064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d360c8f-5e61-474b-b79a-39b1d739bdb3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.879872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.885473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.886459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.886739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.887555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.888457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:41.888754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.890188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.898678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 611/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:41.904667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.995169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:42.023214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dce49f-1755-4ad1-bfd0-cc5b0500588c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:42.065011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:42.065712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:42.065990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:42.066263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:42.078902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:42.080675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:42.099388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:42.100607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:42.101697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:42.101697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:42.101697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:42.101697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 640/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:42.107611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:42.232115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db440f-9967-43bf-b090-bf7679b52f14 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:42.271084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:42.271684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:42.271965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:42.272234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:42.272898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:42.273195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:42.274551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:42.287882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 612/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:42.293857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:42.407091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c492a38-5d21-4297-b320-6f32b8b7951e None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:42.436074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:42.445546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:42.446211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:42.446498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:42.446807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:42.456101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:42.457884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:42.470687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:42.471717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:42.472710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 641/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:42.478259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:42.543906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:42.598840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85089004-2ffd-4e46-bbc3-d2c491df9ee1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:42.635232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:42.635763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:42.636046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:42.636315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:42.637173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:42.637481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:42.639135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:42.661707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 613/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:42.671019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:42.800172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba3425-979f-4ea0-ad3d-8685c0fcda8c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:42.842069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:42.842680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:42.842961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:42.843224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:42.903703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:42.916511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:42.917979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.026806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 642/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:46:43.034002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:43.147951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ccf14-e9ce-41df-b544-99e2920cddd2 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:43.162647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:43.184197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:43.184850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.185129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.185440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.196828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:43.198303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:43.213258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:43.214458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:43.215487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:43.215487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:43.215487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:43.215487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 614/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:43.220113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:43.313014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:43.329039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96f26d2-9fce-4b96-bc06-5b182dc0da57 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:43.367151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:43.367752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.368029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.368297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.368963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:43.369263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:43.370620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.383099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 643/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:43.389621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:43.503855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3dbf2-a76b-4534-ba66-3968405870a1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:43.540036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:43.540848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.541256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.541689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.549733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:43.551323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:43.570750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:43.571831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:43.572775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:43.573211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 615/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:43.582120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:43.705057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f816eb-0d9f-4d1e-bd7a-c2d41e49420f None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:43.744911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:43.745515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.745795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.746066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.747331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:43.747633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:43.749092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85c6b64-7d0e-40e9-92b6-faedc9e9925a None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.764864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 644/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:43.773592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:43.816964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:43.898939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff075068-6435-4ca2-923d-f9a3fef22524 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:43.936998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:43.937573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.937913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.938176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.938972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=51e6b673144045b5baffab410e261706) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:43.939273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:43.940723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d289fa9-c535-47d4-a188-39f6df52fc63 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:43.946278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 616/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:43 2022] GET /identity/v3/role_assignments?user.id=51e6b673144045b5baffab410e261706&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:45.851253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba46d-ea0f-4c46-a576-df974401de0b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.851814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba46d-ea0f-4c46-a576-df974401de0b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.851814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eba46d-ea0f-4c46-a576-df974401de0b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.853150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 645/1261] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:45.858181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.858554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.858726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.876763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:45.877943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:45.942656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 617/1262] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:46.212116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba46d-ea0f-4c46-a576-df974401de0b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.223900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.311758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eba46d-ea0f-4c46-a576-df974401de0b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.345557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.346187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.346468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.346743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.357343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:46.362224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:46.363311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:46.364280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 646/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:46.369354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.387197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.466124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabd45d-1b59-4cfc-ac83-73a08b0f9a1e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.499062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.499660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.499940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.500213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.500903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:46.501206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.502568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.510455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 618/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:46.516716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.581589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.613964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2e8fd-8591-4b48-8073-9136259bf76c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.647408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.648025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.648304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.648602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.659207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.660683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:46.674645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:46.675768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:46.676747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:46.676747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:46.676747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:46.676747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 647/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:46.681545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.763019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.786742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bd553-879d-4a3b-a1d7-29278c5b1196 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.826312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.826926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.827210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.827485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.828128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:46.828477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.829970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.843831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 619/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:46.849303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.944476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c6c6e-7c12-419d-8ae5-c5c6454e81de None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.963461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.977842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.978464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.978745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.979022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.987315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.988781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:46.999943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:47.001107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:47.002073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 648/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:47.006817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.102673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff220c-b887-4371-a094-bdda300d5875 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.135678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.136273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.137216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.137490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.138249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:47.138551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.139981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.148360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:47.156843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 620/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:47.162530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.259387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b7ee8-df7e-4015-bd79-9aec220c8e52 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.291138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.291753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.292030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.292301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.303173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.304644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:47.318640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:47.319834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:47.320800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:47.320800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:47.320800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:47.320800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 649/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:47.325873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.421708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f907e8-dc50-4276-a358-5451518373f0 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.454438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.455032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.455307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.455576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.456200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:47.456526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.457884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.468541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 621/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:47.474172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.505834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:47.572578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4044e06f-42e1-4a40-b026-21b58cbcd4b2 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.605979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.606595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.606871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.607141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.613796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.615226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:47.626536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:47.627613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:47.628951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 650/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:47.633492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.691372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:47.731621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25c8170-8817-4993-a59a-05917c5a843d None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.764854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.765707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.766102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.766569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.767807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:47.768254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.770103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b755af-b936-4664-a167-29a3b305bcfb None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.785855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 622/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:47.792456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:47.882244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:47.891409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33155620-c9d2-4c9d-abc9-939ce35ab4b8 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:47.924518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:47.925162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.925444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.925718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] PATH_INFO: `/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/51e6b673144045b5baffab410e261706/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.927627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f318c94ba4141a7ab2d48b7abecbb9b, user_id=51e6b673144045b5baffab410e261706, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:47.929091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca451443-2a92-407f-94e7-376b99d73cf8 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:47.942718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 651/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu Aug 25 02:46:47 2022] PUT /identity/v3/projects/0f318c94ba4141a7ab2d48b7abecbb9b/users/51e6b673144045b5baffab410e261706/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:46:49.813036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ea43-0637-429b-a37a-c65c7fa66443 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:49.813569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ea43-0637-429b-a37a-c65c7fa66443 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:49.813569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa59ea43-0637-429b-a37a-c65c7fa66443 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:49.815011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 623/1274] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:49.820221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:49.820704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:49.820818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:49.839004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:49.840877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:49.904852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 652/1275] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:50.170425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59ea43-0637-429b-a37a-c65c7fa66443 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.270472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa59ea43-0637-429b-a37a-c65c7fa66443 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:50.287901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:50.304786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:50.305402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.305679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.305949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.315772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:50.320467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:50.321608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:50.322502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 624/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:50.328025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.410593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:50.428913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef62acb-2fbf-4467-a49c-3719c0f37c44 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:50.462613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:50.463220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.463501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.463775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.465059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:50.465367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:50.466727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:50.474592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 653/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:50.480284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.577669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac9d1-cb80-4a78-bccc-18bfc1eaee60 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:50.610104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:50.610717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.611254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.611531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.622145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:50.623574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:50.637579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:50.638578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:50.639587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:50.639587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:50.639587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:50.639587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 625/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:50.644572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.742718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473cf68-95da-4662-849e-a1f8e92b78a4 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:50.781760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:50.782459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.782732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.783171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.783765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:50.784097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:50.785728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:50.799340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 654/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:50.805965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.842045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:50.909320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed81bc-824f-467e-ae6f-7f81197bb33b None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:50.941391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:50.942028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.942305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.942575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.950249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:50.951674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:46:50.962281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:50.963459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:50.964771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 626/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:50.969388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:50.973168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.067023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f39e-80b4-45be-8be2-3029857eecc0 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.099171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.099758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.100041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.100314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.101063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:51.101363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.102784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.119950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 655/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu Aug 25 02:46:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:51.126273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.214668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.224109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135685-70bc-4337-bbee-14729dda8571 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.257649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.258239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.258514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.258783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.322039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.323399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.413784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.424983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 627/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:46:51.430768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.495663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.533515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca93a7b-664c-4b6e-b39b-abdd7321c3cb None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.566584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.567200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.567480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.567758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.577827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.579218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:51.593734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:51.594890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:51.595851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:51.595851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:51.595851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:51.595851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 656/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:51.600531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.697670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53160b-15ba-4609-ad90-90efd53e9cec None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.731077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.731671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.731952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.732226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.732888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:51.733192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.734559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.745669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 628/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:51.751438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.853669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4009d7a0-492c-4ad7-94db-2294c1921b48 None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.866782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.886020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.887144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.887419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.887688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.894034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.895456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:46:51.907552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:51.908627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: ERROR keystone.server.flask.application Aug 25 02:46:51.909757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 657/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:51.914733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.962988 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:52.012055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15777cf4-e8d0-405c-b6b4-1f498f2bb6b1 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:52.044514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:52.045109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:52.045388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:52.045659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:52.046338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:52.046639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:52.048051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961109-6686-4af0-ad28-fc3b28af24c1 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:52.059447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 629/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:52.065595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:52.162464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d15a2f-412b-4a8c-8f2f-d22452296c1c None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:52.194373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:52.194956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:52.195234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:52.195505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:52.196212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] RBAC: Adding query filter params (role.id=3643a2fbd54c49d3b2dc7f769bd3aa79, scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b, user.id=51e6b673144045b5baffab410e261706) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:52.196546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:52.197954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7b9ce-92b2-4aaf-96db-95c16a4b5e8b None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:52.203999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 658/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:52 2022] GET /identity/v3/role_assignments?user.id=51e6b673144045b5baffab410e261706&scope.project.id=0f318c94ba4141a7ab2d48b7abecbb9b&role.id=3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:54.116585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dff5a-dd4c-4c2b-b78a-210a35d05829 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.117122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dff5a-dd4c-4c2b-b78a-210a35d05829 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.117122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dff5a-dd4c-4c2b-b78a-210a35d05829 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.118590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 630/1288] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:54.124104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.124591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.124693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.142951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:54.144142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:54.172916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:54.209109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 659/1289] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:54.479112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dff5a-dd4c-4c2b-b78a-210a35d05829 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:54.586666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469dff5a-dd4c-4c2b-b78a-210a35d05829 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:54.600963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:54.627550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:54.628176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.628484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.628763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.629341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:54.630705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:54.639407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:54.640639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:54.641789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 631/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:46:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:54.646489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:54.745531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf2fef-13ee-46f1-a224-c3816c80c622 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:54.785942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:54.786619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.786906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.787325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.788090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:54.788350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:54.790025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13454c1-c951-466b-9ce2-ae6c0eb9c720 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:54.796464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 660/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Aug 25 02:46:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:54.804032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:54.923694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89266128-7c32-466c-bc9a-946a94b5e99e None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:54.957679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:54.958284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.958562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.958836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] PATH_INFO: `/v3/services` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.959467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:54.959769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:54.961175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835d8db-dc4d-426c-8dab-074aef3776b4 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:54.966544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 632/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Aug 25 02:46:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.829357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f08f-33bd-4470-b7f4-5915f2d6b7a2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.829907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f08f-33bd-4470-b7f4-5915f2d6b7a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.829907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd51f08f-33bd-4470-b7f4-5915f2d6b7a2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.831221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 661/1293] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:56.836469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a51a-1d9a-49ee-8610-5bbf1ff23880 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.836874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a51a-1d9a-49ee-8610-5bbf1ff23880 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.837023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5a51a-1d9a-49ee-8610-5bbf1ff23880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.854715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7da5a51a-1d9a-49ee-8610-5bbf1ff23880 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:56.855903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7da5a51a-1d9a-49ee-8610-5bbf1ff23880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:56.885127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.922207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 633/1294] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:57.188011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f08f-33bd-4470-b7f4-5915f2d6b7a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.218111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.285843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd51f08f-33bd-4470-b7f4-5915f2d6b7a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.319779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.320374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.320680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.320953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.321584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.322945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d03e9-578a-4ad7-9499-2e6097b210d5 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.336976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 662/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu Aug 25 02:46:57 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:59.244737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1882a-b413-4646-b92a-0e5ccc2f9924 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.245841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1882a-b413-4646-b92a-0e5ccc2f9924 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.245937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1882a-b413-4646-b92a-0e5ccc2f9924 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.247269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 634/1296] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:46:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:59.252478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.252896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.253034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.270677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:59.271871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:59.341577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 663/1297] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:59 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:46:59.607525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1882a-b413-4646-b92a-0e5ccc2f9924 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:59.708168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1882a-b413-4646-b92a-0e5ccc2f9924 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:59.742656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:59.743277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.743557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.743831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] PATH_INFO: `/v3/services/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.744425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:59.745829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:59.754235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:59.755306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:46:59.756786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 635/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:46:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:59.761680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:59.781761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:59.867733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a758f-45cd-40f1-bcc4-424ae22ebd3d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:59.901920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:59.902515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.902792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.903065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.903684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:59.903982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:59.905370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:59.910399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 664/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Aug 25 02:46:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:59.916813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:59.949492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.018101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7cd44-f5de-449d-818d-b837a85e1caa None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.051900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:00.052523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.052807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.053087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.053782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] RBAC: Adding query filter params (interface=public, service_id=8eaae1feea6a459c963958a9fc2f4db3, region_id=RegionOne) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:00.054089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:00.055490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac1c94-88e8-42ae-af54-db3b2359d94e None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:00.060451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 636/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu Aug 25 02:46:59 2022] GET /identity/v3/endpoints?service_id=8eaae1feea6a459c963958a9fc2f4db3&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:00.066157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:00.144729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.163320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b20c8-19a5-4c75-b381-f08055a6a50d None admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.196639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:00.197279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.197561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.197828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.200168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:00.201576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7612e3-0781-47f2-bea2-67a15b4571e7 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:00.208630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 665/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu Aug 25 02:47:00 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:47:02.147671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0904-3c92-4e09-b567-1251c61ed141 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.148203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0904-3c92-4e09-b567-1251c61ed141 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.148203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f0904-3c92-4e09-b567-1251c61ed141 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.149602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 637/1302] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:02.154671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.155180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.155291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.173092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:02.174272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:02.239230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 666/1303] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:47:02.504661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0904-3c92-4e09-b567-1251c61ed141 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.596616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.603542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f0904-3c92-4e09-b567-1251c61ed141 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.636300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.636931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.637206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.637473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.638040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.639389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:02.647665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:02.648853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: ERROR keystone.server.flask.application Aug 25 02:47:02.649711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 638/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:02.655282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.728029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.751103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e4cc4-aa02-4752-9892-375cc4c6ed5a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.783844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.784378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.784690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.784962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] PATH_INFO: `/v3/services` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.785584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:02.785885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.787236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55a418-545b-44b2-8769-064ae683e519 None admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.792796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 667/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.798638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.894547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30d463-5a9a-421f-9671-574b5f51a972 None admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.928163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.928792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.929073 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.929346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.929993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.931359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbcbff-38a5-415b-8e40-75960eb83694 None admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.950275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 639/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:47:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:12.789358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=30 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:12.946887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.304836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2eaa2-d269-42db-b9fd-0de9fceb924e None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.305417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2eaa2-d269-42db-b9fd-0de9fceb924e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.305417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2eaa2-d269-42db-b9fd-0de9fceb924e None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.308774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 668/1307] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:07.312056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ee4-4ec4-4856-8e7b-fa09b4aef165 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.312502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ee4-4ec4-4856-8e7b-fa09b4aef165 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.312604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c3ee4-4ec4-4856-8e7b-fa09b4aef165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.392060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bc0c3ee4-4ec4-4856-8e7b-fa09b4aef165 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:07.393548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bc0c3ee4-4ec4-4856-8e7b-fa09b4aef165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:07.513054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 640/1308] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:07.841406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.842042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.842586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.844362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 669/1309] 10.222.0.64 () {54 vars in 965 bytes} [Thu Aug 25 02:48:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:07.852956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cdb9-e463-4213-9e8c-6f89e8ad0cc3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.853244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cdb9-e463-4213-9e8c-6f89e8ad0cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.853521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99cdb9-e463-4213-9e8c-6f89e8ad0cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.952596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5b99cdb9-e463-4213-9e8c-6f89e8ad0cc3 None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:07.953757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5b99cdb9-e463-4213-9e8c-6f89e8ad0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:07.977934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.041428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 641/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Aug 25 02:48:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 25 02:48:08.050811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.052894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:08.197879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab9250-c8c5-4aef-85c5-3108c2d0ae69 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.297517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.298396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.298790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.299191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.301248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:08.373952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.449798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.451861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36bb8d-f5a2-4abe-9aca-b13b10fd0609 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.473635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 670/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:10.708146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.708719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.708719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.710362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 642/1312] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:10.715610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69dbc3-a528-418f-9530-3c85272f1e7d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.716039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69dbc3-a528-418f-9530-3c85272f1e7d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.716162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69dbc3-a528-418f-9530-3c85272f1e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.798483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9e69dbc3-a528-418f-9530-3c85272f1e7d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:10.799730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e69dbc3-a528-418f-9530-3c85272f1e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:10.909782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 671/1313] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:11.193015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.194574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:11.299510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46edcc-ba0c-425d-9db8-45e6fa156b4d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.375121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.380860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.380860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.380860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.380860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.383773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:11.496187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.497580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798bf31e-f07a-4ce6-a8c0-64f3453bc7c9 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.516228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 643/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:13.720800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.721364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.721364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.722704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 672/1315] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:13.728373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2654-dd41-4a23-af11-6309c48a2c29 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.728820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2654-dd41-4a23-af11-6309c48a2c29 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.728912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2654-dd41-4a23-af11-6309c48a2c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.809474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-265f2654-dd41-4a23-af11-6309c48a2c29 None None] MFA Rules not processed for user `375655afad124666b85edc0c98a1dce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:13.814512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-265f2654-dd41-4a23-af11-6309c48a2c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:13.864680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.909329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 644/1316] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:13 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:14.197218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.198817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:14.208489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.301960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b77b66-b853-41cb-a022-2be11e4ee0a5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.373412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.374105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.374382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.374647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.376244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:14.439616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.486578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.487934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c023343-0458-4cc7-8223-d2eeac5c29ac service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.505857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 673/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:16.957564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2313ab-014d-44b1-a5b5-76e16302e2f9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.958106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2313ab-014d-44b1-a5b5-76e16302e2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.958106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2313ab-014d-44b1-a5b5-76e16302e2f9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.959961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 645/1318] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:16.965332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c339e-a4e9-4e79-96ac-a04b5f49b5c1 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.965801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c339e-a4e9-4e79-96ac-a04b5f49b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.965885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c339e-a4e9-4e79-96ac-a04b5f49b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.029986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d06c339e-a4e9-4e79-96ac-a04b5f49b5c1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:17.031207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d06c339e-a4e9-4e79-96ac-a04b5f49b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.128566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 674/1319] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:17.426517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.426799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.427076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.428448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 646/1320] 10.222.0.64 () {54 vars in 965 bytes} [Thu Aug 25 02:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:17.434554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959dc48-2935-407f-947b-497338107dc2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.434842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959dc48-2935-407f-947b-497338107dc2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.435118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959dc48-2935-407f-947b-497338107dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.457103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.511505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c959dc48-2935-407f-947b-497338107dc2 None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:17.512743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c959dc48-2935-407f-947b-497338107dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.587883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 675/1321] 10.222.0.64 () {58 vars in 1062 bytes} [Thu Aug 25 02:48:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:17.597032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.598562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.699692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4fdd35-ec69-470c-a633-b695784cca8d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.775472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.776089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.776366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.776664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.778268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.785885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.887867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.889350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573ca3e-b9d3-474e-8943-23ad2a6f547b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.907279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 647/1322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:20.922839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.923376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.923494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.924901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 676/1323] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:20.931442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887651e0-6248-4530-aa65-3b5e02a0c0ee None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.931875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887651e0-6248-4530-aa65-3b5e02a0c0ee None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.932088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887651e0-6248-4530-aa65-3b5e02a0c0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.003131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-887651e0-6248-4530-aa65-3b5e02a0c0ee None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:21.004349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-887651e0-6248-4530-aa65-3b5e02a0c0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:21.065783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.110115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 648/1324] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:21.394958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.397233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:21.505417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9781df-84c4-40ed-b7ff-f2f937e42069 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.521076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.590841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.591487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.591856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.592218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.593980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:21.709520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.710963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b514ff3-2ab3-47cf-aafe-b6c0096836fa service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.730184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 677/1325] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:23.751182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.751782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.751782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.753254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 649/1326] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:23.759008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f31f4-7dcc-40ec-aca8-830a298cc060 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.759496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f31f4-7dcc-40ec-aca8-830a298cc060 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.759975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f31f4-7dcc-40ec-aca8-830a298cc060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.811012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.830521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1f8f31f4-7dcc-40ec-aca8-830a298cc060 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:23.831761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1f8f31f4-7dcc-40ec-aca8-830a298cc060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:23.932625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 678/1327] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:24.220009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.221572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:24.338523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba9e52-6cf0-48fd-82c2-a244e88e9b2e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.416704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.417317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.417595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.417867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.419488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:24.437761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.542641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.544338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e75cd7-6eff-4229-9f39-acb4f9c3d6af service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.563465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 650/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:26.542777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.543370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.543370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.544729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 679/1329] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:26.550408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff740d32-ad28-4a0f-b4d3-f3914f3772bc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.550867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff740d32-ad28-4a0f-b4d3-f3914f3772bc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.550966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff740d32-ad28-4a0f-b4d3-f3914f3772bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.620189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ff740d32-ad28-4a0f-b4d3-f3914f3772bc None None] MFA Rules not processed for user `375655afad124666b85edc0c98a1dce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:26.621407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ff740d32-ad28-4a0f-b4d3-f3914f3772bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:26.688138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.723546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 651/1330] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:26 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:48:27.009197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.010749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:27.122501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc13a5-bf15-465d-875e-0b7be1a07e73 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.143080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.199207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.199824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.200160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.200380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.202039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:27.328248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.330058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f91489-194f-417c-96e1-1427dd06fa26 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.350555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 680/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:29.533364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749378-328d-4022-b81c-6a706df3ecae None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.533887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749378-328d-4022-b81c-6a706df3ecae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.533887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749378-328d-4022-b81c-6a706df3ecae None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.535251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 652/1332] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:29.541204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c26ee-189e-4ce4-abc9-82e33b08c016 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.541611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c26ee-189e-4ce4-abc9-82e33b08c016 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.541756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707c26ee-189e-4ce4-abc9-82e33b08c016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.604599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.607362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-707c26ee-189e-4ce4-abc9-82e33b08c016 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:29.609236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-707c26ee-189e-4ce4-abc9-82e33b08c016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:29.704816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 681/1333] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:29.989394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749378-328d-4022-b81c-6a706df3ecae None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.990973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-67749378-328d-4022-b81c-6a706df3ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:30.094780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749378-328d-4022-b81c-6a706df3ecae None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.167224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.167824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.168101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.168372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.170001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:30.196621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.278053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.279406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913bba8-cb74-4559-9ad4-3bd433c20039 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.297148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 653/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:32.252466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.253140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.253140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.254537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 682/1335] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:32.260356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35979c-04fa-4ff1-bc8d-fe8b405f6e9e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.260796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35979c-04fa-4ff1-bc8d-fe8b405f6e9e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.260931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35979c-04fa-4ff1-bc8d-fe8b405f6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.325978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9d35979c-04fa-4ff1-bc8d-fe8b405f6e9e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:32.327187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9d35979c-04fa-4ff1-bc8d-fe8b405f6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.400821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.422707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 654/1336] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:32.703439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.705024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.806588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaa315-9ce5-4e9d-baf2-d6c1e12a0a41 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.834539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.879324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.879926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.880207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.880508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.882671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.989248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.991158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c43ce-0039-404c-8de3-9b0948165600 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:33.008739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 683/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:35.307749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.308277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.308426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.309751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 655/1338] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:35.314951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf328f-0d67-4f69-a28c-1f08d99931d0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.315327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf328f-0d67-4f69-a28c-1f08d99931d0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.315509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf328f-0d67-4f69-a28c-1f08d99931d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.382050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f5cf328f-0d67-4f69-a28c-1f08d99931d0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:35.383265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f5cf328f-0d67-4f69-a28c-1f08d99931d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.391560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.478805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 684/1339] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:35.765605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.767269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.869676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bbb721-241a-49c1-ac22-2aa5faf508ae None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.942124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.942727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.943005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.943275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.945480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.979894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.052365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.054341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cabe5d-f5cf-49f6-8161-4b58eac21b8a service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.072342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 656/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:39.895000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.895537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.895818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.897848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 685/1341] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:39.903235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2c68-f648-4530-9858-2b667b108685 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.903634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2c68-f648-4530-9858-2b667b108685 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.903780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e2c68-f648-4530-9858-2b667b108685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.970940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-410e2c68-f648-4530-9858-2b667b108685 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:39.972132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-410e2c68-f648-4530-9858-2b667b108685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:40.057564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.070220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 657/1342] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:40.353983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:40.355516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:40.460821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb903a1-0f44-4f98-99ab-57dd8cd9d74b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.501034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.537009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.538163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.538437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.538701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.540315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:40.652717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:40.654077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386c648-a369-42ec-865f-ad752624fd1c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:40.672742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 686/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:43.160925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.161479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.161479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.163442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 658/1344] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:43.169167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae134-646a-4240-a413-f75aa09eb2ab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.169763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae134-646a-4240-a413-f75aa09eb2ab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.169763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adae134-646a-4240-a413-f75aa09eb2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.242380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1adae134-646a-4240-a413-f75aa09eb2ab None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:43.243595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1adae134-646a-4240-a413-f75aa09eb2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:43.262175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:43.345527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 687/1345] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:43.629930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:43.632044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:43.740679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e91d4-b430-4e2c-b0a1-3e4da6309224 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.816813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.817420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.817695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.817966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.820046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:43.864558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:43.934080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.935522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92355016-ae61-4691-80c8-b03e7faaa584 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.953569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 659/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:47.851093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.851584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.851690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.853284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 688/1347] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:47.858492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dc5e-9371-4df9-b4ee-afb745be22ca None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.858959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dc5e-9371-4df9-b4ee-afb745be22ca None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.859070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298dc5e-9371-4df9-b4ee-afb745be22ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.938694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e298dc5e-9371-4df9-b4ee-afb745be22ca None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:47.939916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e298dc5e-9371-4df9-b4ee-afb745be22ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:48.047277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:48.052440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 660/1348] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:48.334831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:48.336812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:48.450483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710534c-d49c-4957-b2ba-1c1ef76cf532 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:48.499818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:48.528326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:48.528978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.529259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.529528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.531159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:48.642370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:48.643820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff54a37-42e3-4b95-af60-57b26e368859 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:48.661449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 689/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:48:53.526544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e6ff-b7a3-4088-bd36-b08371c09370 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:53.527089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e6ff-b7a3-4088-bd36-b08371c09370 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:53.527089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716e6ff-b7a3-4088-bd36-b08371c09370 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:53.528470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 661/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:53.533522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac2f1-56fb-44c3-80ee-69af0fd830a7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:53.533922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac2f1-56fb-44c3-80ee-69af0fd830a7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:53.534070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ac2f1-56fb-44c3-80ee-69af0fd830a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:53.638026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-392ac2f1-56fb-44c3-80ee-69af0fd830a7 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:53.640961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-392ac2f1-56fb-44c3-80ee-69af0fd830a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:53.660468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:53.796052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 690/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:48:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:58.047951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ad3a-024e-4f21-9e4c-8aafe75e3704 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.048786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ad3a-024e-4f21-9e4c-8aafe75e3704 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.048786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ad3a-024e-4f21-9e4c-8aafe75e3704 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.050084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 662/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:58.055526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1533-8185-4cf5-847a-adcda11c5cb6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.056357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1533-8185-4cf5-847a-adcda11c5cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.056903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb1533-8185-4cf5-847a-adcda11c5cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.138549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1ebb1533-8185-4cf5-847a-adcda11c5cb6 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:58.140139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ebb1533-8185-4cf5-847a-adcda11c5cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:58.218643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:58.259322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 691/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:48:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:48:59.497064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457e12-b4ab-40f7-9b27-bbdf12b2a2fc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.497582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457e12-b4ab-40f7-9b27-bbdf12b2a2fc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.497582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8457e12-b4ab-40f7-9b27-bbdf12b2a2fc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.498975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 663/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:59.504195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e259-f63d-4641-9265-b3cf4532bec8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.504611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e259-f63d-4641-9265-b3cf4532bec8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.504767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e259-f63d-4641-9265-b3cf4532bec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.582136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2d69e259-f63d-4641-9265-b3cf4532bec8 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:59.583344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2d69e259-f63d-4641-9265-b3cf4532bec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:59.689337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 692/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:48:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:03.075529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae15f9-c8ef-4a29-a826-aa80b6e00d77 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.076052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae15f9-c8ef-4a29-a826-aa80b6e00d77 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.076052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae15f9-c8ef-4a29-a826-aa80b6e00d77 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.077590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 664/1356] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:03.082515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220fc7-627f-4e18-b1d1-f18798e03a05 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.082899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220fc7-627f-4e18-b1d1-f18798e03a05 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.083060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e220fc7-627f-4e18-b1d1-f18798e03a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.120765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:03.154596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0e220fc7-627f-4e18-b1d1-f18798e03a05 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:03.155881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0e220fc7-627f-4e18-b1d1-f18798e03a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:03.268773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 693/1357] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:03.587064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.587983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.589103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.590654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 665/1358] 10.222.0.64 () {54 vars in 962 bytes} [Thu Aug 25 02:49:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:03.600909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbbd2-513c-4d15-9a96-8e80206ce3ce None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.600909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbbd2-513c-4d15-9a96-8e80206ce3ce None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.601241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bbbbd2-513c-4d15-9a96-8e80206ce3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.684629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f0bbbbd2-513c-4d15-9a96-8e80206ce3ce None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:03.685830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f0bbbbd2-513c-4d15-9a96-8e80206ce3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:03.738260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:03.819228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:03.821803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:03.826552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 694/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Aug 25 02:49:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:03.978072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccee4d1-fc39-4c69-93db-6bb2604f9c21 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.058010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.100658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.101326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.101520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.101971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.103555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:04.200179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.201829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc4abf7-f241-46ac-8b3c-9a60a6933f0e service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.220455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 666/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:06.448218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:06.448679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:06.449793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:06.450637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 695/1361] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:06.456633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eb986-9488-4b12-94eb-50a4926bd1c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:06.457043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eb986-9488-4b12-94eb-50a4926bd1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:06.457705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5eb986-9488-4b12-94eb-50a4926bd1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:06.536174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ca5eb986-9488-4b12-94eb-50a4926bd1c3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:06.537464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ca5eb986-9488-4b12-94eb-50a4926bd1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:06.576606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:06.644449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 667/1362] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:06.948207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:06.948207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:07.108858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a38b1bc-86f5-469e-8b3f-2f09c34acf8f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:07.119526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:07.228457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:07.229069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:07.229368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:07.229645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:07.231243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:07.330832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:07.333890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccca3bf-07c1-4eb2-97f1-f56a6e69cbbd service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:07.361745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 696/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:09.601846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4992-0fcd-4118-aa87-41d5c2e16ec6 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:09.602372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4992-0fcd-4118-aa87-41d5c2e16ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:09.602372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4992-0fcd-4118-aa87-41d5c2e16ec6 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:09.603747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 668/1364] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:09.610057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7eef-6256-4993-9510-4f44bd38ce29 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:09.610502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7eef-6256-4993-9510-4f44bd38ce29 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:09.611109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc7eef-6256-4993-9510-4f44bd38ce29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:09.634687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:09.696518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e6fc7eef-6256-4993-9510-4f44bd38ce29 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:09.698076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e6fc7eef-6256-4993-9510-4f44bd38ce29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:09.804979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 697/1365] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:10.105488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.105939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.107039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.109539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 669/1366] 10.222.0.64 () {54 vars in 962 bytes} [Thu Aug 25 02:49:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:10.117348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38b98-6c28-4740-8963-f75d51a5b4eb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.117633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38b98-6c28-4740-8963-f75d51a5b4eb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.117904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd38b98-6c28-4740-8963-f75d51a5b4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.199869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8bd38b98-6c28-4740-8963-f75d51a5b4eb None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:10.201269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8bd38b98-6c28-4740-8963-f75d51a5b4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:10.238963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.326584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 698/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Aug 25 02:49:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:10.335172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.336706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:10.509614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56660b0-e8f6-49f7-be40-7619ee5153af None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.531740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.643681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.644308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.644564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.644806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.646457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:10.746867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.748521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b3a90-1265-413b-a6bc-837de551ecf4 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.767619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 670/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:11.416945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21df00-c4d9-43bc-af5a-17f1657db911 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:11.417544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21df00-c4d9-43bc-af5a-17f1657db911 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:11.417544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b21df00-c4d9-43bc-af5a-17f1657db911 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:11.419022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 699/1369] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:11.423985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4614-f5df-4c01-9129-4033975c1524 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:11.424269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4614-f5df-4c01-9129-4033975c1524 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:11.424574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af4614-f5df-4c01-9129-4033975c1524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:11.457436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:11.497241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-23af4614-f5df-4c01-9129-4033975c1524 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:11.498368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-23af4614-f5df-4c01-9129-4033975c1524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:11.600811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 671/1370] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:12.185510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.185510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.185510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.188426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 700/1371] 10.222.0.64 () {54 vars in 964 bytes} [Thu Aug 25 02:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:12.191917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f538-db9d-4554-9091-8b4eb5fb2b4d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.192460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f538-db9d-4554-9091-8b4eb5fb2b4d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.192626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f538-db9d-4554-9091-8b4eb5fb2b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.273497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-04e1f538-db9d-4554-9091-8b4eb5fb2b4d None None] MFA Rules not processed for user `23232654097d435a9ebe540ada43804d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:12.274721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-04e1f538-db9d-4554-9091-8b4eb5fb2b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:12.325072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:12.356821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 672/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Aug 25 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:12.364624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:12.366750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:12.483652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa0bac-fd24-4b42-8b13-c3c8f0f19edf None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:12.533797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:12.582535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:12.583491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.584511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.585047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.587232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:12.735701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:12.737950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:12.761341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84e900-ae37-4034-9159-464cfcb9da4b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.761642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84e900-ae37-4034-9159-464cfcb9da4b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.761786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84e900-ae37-4034-9159-464cfcb9da4b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.765079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 673/1373] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:12.767995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789a74e-e7c9-4464-b5a7-5bf981b1d014 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.768451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789a74e-e7c9-4464-b5a7-5bf981b1d014 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.768720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789a74e-e7c9-4464-b5a7-5bf981b1d014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.775574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 701/1374] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:12.842790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9789a74e-e7c9-4464-b5a7-5bf981b1d014 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:12.843915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9789a74e-e7c9-4464-b5a7-5bf981b1d014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:12.965073 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 674/1375] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:13.253100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:13.254317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:13.321354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:13.355824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f3ae7-e634-4df3-824e-e32d84774bbf service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:13.478801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:13.479363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:13.479642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:13.479916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:13.481607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:13.561849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:13.572642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:13.574278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf4684-3ef5-444e-942c-2f83d13b5911 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:13.592797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 702/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:15.529336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:15.529893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:15.529893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:15.531235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 675/1377] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:15.536567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417054c-052c-4f60-bde7-57f5e1cae4e9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:15.537027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417054c-052c-4f60-bde7-57f5e1cae4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:15.537846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417054c-052c-4f60-bde7-57f5e1cae4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:15.610273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2417054c-052c-4f60-bde7-57f5e1cae4e9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:15.610273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2417054c-052c-4f60-bde7-57f5e1cae4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:15.720214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 703/1378] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:16.010502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:16.012010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:16.067999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.165555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadf647e-7edb-4f17-a807-be45c384d1ac None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.308346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.309443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.309723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.309995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.311594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:16.326677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.430288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.432028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52072b90-1937-4540-b9ce-722c58657e2f service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.451226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 676/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:18.421349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:18.421875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:18.421875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:18.423438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 704/1380] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:18.428639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce419f-4ad5-41c4-b0d2-fedeb3dcdf06 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:18.429038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce419f-4ad5-41c4-b0d2-fedeb3dcdf06 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:18.429206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ce419f-4ad5-41c4-b0d2-fedeb3dcdf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:18.498338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-62ce419f-4ad5-41c4-b0d2-fedeb3dcdf06 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:18.499539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-62ce419f-4ad5-41c4-b0d2-fedeb3dcdf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:18.591238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:18.605165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 677/1381] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:18.903836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:18.905401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:18.972063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:19.069453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3915d1-3dbb-49da-b971-174343d20359 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:19.211826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:19.212666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:19.213045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:19.213546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:19.215390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:19.241949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:19.323920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:19.325562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dac737-a030-40e2-bb80-5aa5d7b43c07 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:19.350946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 705/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:21.301116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.301798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.301798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.303633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 678/1383] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:21.311050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cc15-5c74-4097-81fa-755716adf36b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.311570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cc15-5c74-4097-81fa-755716adf36b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.311777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578cc15-5c74-4097-81fa-755716adf36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.385237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f578cc15-5c74-4097-81fa-755716adf36b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:21.386169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f578cc15-5c74-4097-81fa-755716adf36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:21.487170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:21.490889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 706/1384] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:21.864090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:21.867024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:22.019320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bb72f-a83b-4352-ab20-970a4c4a078b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:22.082394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:22.138385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:22.138918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:22.139203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:22.139474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:22.141109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:22.231155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:22.232793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4116-86d5-4e5f-9433-ea172f71d813 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:22.251301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 679/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:24.265199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.265753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.265753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.267118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 707/1386] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:24.273282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc611a-0c42-47e4-80c9-1a245e0cdddf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.273746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc611a-0c42-47e4-80c9-1a245e0cdddf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.273846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc611a-0c42-47e4-80c9-1a245e0cdddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.379422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-52fc611a-0c42-47e4-80c9-1a245e0cdddf None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:24.382151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-52fc611a-0c42-47e4-80c9-1a245e0cdddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:24.417544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:24.494142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 680/1387] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:24.889191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:24.891608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:25.047419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe86509c-4ffb-4d4f-962c-e513a6c475d6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:25.132414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:25.183420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:25.184072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:25.184430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:25.184687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:25.186255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:25.277109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:25.278738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472e347-8669-4e59-bef8-1a7ffd1221fe service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:25.297508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 708/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:27.241160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.241641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.241837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.243358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 681/1389] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:27.248623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578087-28ca-4503-9a1e-b023cddeca61 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.249016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578087-28ca-4503-9a1e-b023cddeca61 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.249177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40578087-28ca-4503-9a1e-b023cddeca61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.316020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-40578087-28ca-4503-9a1e-b023cddeca61 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:27.317253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-40578087-28ca-4503-9a1e-b023cddeca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:27.354528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:27.420259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 709/1390] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:27.707446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:27.709656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:27.766194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ce1c-2578-4b5f-a253-ba7024c888fa None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.766485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ce1c-2578-4b5f-a253-ba7024c888fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.766760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1ce1c-2578-4b5f-a253-ba7024c888fa None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.768101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 710/1391] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:27.773748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f317-9a8c-4116-8c59-0d019409c245 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.774027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f317-9a8c-4116-8c59-0d019409c245 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.774302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6f317-9a8c-4116-8c59-0d019409c245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.840925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e9f6f317-9a8c-4116-8c59-0d019409c245 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:27.842171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e9f6f317-9a8c-4116-8c59-0d019409c245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:27.862849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c1572-7589-4607-8264-c65adfc60605 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:27.872255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:27.939174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 711/1392] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:27.977659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:27.978198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.978478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.978755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.980345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:28.067830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:28.070153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d7bb2-baf4-4405-905e-a241ad25f6cd service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:28.088165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 682/1393] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:28.243577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.243869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.244147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.245553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 712/1394] 10.222.0.64 () {54 vars in 967 bytes} [Thu Aug 25 02:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:28.250999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015107-3320-4ebb-9c92-c5ee3e3370cc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.251523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015107-3320-4ebb-9c92-c5ee3e3370cc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.251637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec015107-3320-4ebb-9c92-c5ee3e3370cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.268942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:28.331094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ec015107-3320-4ebb-9c92-c5ee3e3370cc None None] MFA Rules not processed for user `bf080f10671b4fd8aaf6e232d5f8b2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:28.332306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ec015107-3320-4ebb-9c92-c5ee3e3370cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:28.410284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 683/1395] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Aug 25 02:49:28 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:28.417869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:28.419513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:28.438429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:28.527291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1493d5-a041-440b-9f54-34b10a635cde None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:28.601697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:28.602309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.602589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.602863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.604488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:28.674067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:28.713004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:28.714483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811985c0-16a0-4a64-9179-de16a088bbf3 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:28.733372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 713/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:29.466480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c91cd6-e689-49ae-a17e-f18d5cebb0e0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:29.466956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c91cd6-e689-49ae-a17e-f18d5cebb0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:29.466956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c91cd6-e689-49ae-a17e-f18d5cebb0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:29.538709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-65c91cd6-e689-49ae-a17e-f18d5cebb0e0 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:29.539904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65c91cd6-e689-49ae-a17e-f18d5cebb0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:29.597414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:29.635287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 684/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:49:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:29.683376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:29.683899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:29.683899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:29.685454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 714/1398] 10.222.0.64 () {54 vars in 943 bytes} [Thu Aug 25 02:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:29.691517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37c0a-405b-4dcc-8df8-463a6bbdbeeb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:29.691807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37c0a-405b-4dcc-8df8-463a6bbdbeeb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:29.692083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f37c0a-405b-4dcc-8df8-463a6bbdbeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:29.768549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b7f37c0a-405b-4dcc-8df8-463a6bbdbeeb None None] MFA Rules not processed for user `187876bda81c4d66a857ba9d8c4affaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:29.769959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b7f37c0a-405b-4dcc-8df8-463a6bbdbeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:29.878429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 685/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Thu Aug 25 02:49:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:29.888474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:29.889985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.025167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da470378-85d9-4379-8e48-00c16216adc3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:30.045750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bdc7-d486-42fa-9031-479b4533617b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.046038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bdc7-d486-42fa-9031-479b4533617b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.046311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22bdc7-d486-42fa-9031-479b4533617b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.047664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 686/1400] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:30.053522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.053806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.054083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.063832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:30.091014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:30.123020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:30.124241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.131435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:30.132044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.132320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.132621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.134234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.218731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:30.220345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d7776-093d-4347-ad98-83b22a0892ea service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:30.220569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 687/1401] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:49:30.229552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 715/1402] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 02:49:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:49:30.511713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:30.512936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.629510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:30.645737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b382-5792-4c08-82d1-77f26b71f8a9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:30.781407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:30.781407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.781407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.781407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.782395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.910015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:30.912278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d7b47-fcef-47d3-bfe7-26f10eb3d084 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:30.933806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 688/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:32.917397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:32.917991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:32.917991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:32.919315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 716/1404] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:32.924562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456238-e4f3-4dc7-807d-a23eb4faa341 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:32.925706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456238-e4f3-4dc7-807d-a23eb4faa341 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:32.926195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456238-e4f3-4dc7-807d-a23eb4faa341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:32.931886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:33.004547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-81456238-e4f3-4dc7-807d-a23eb4faa341 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:33.006084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-81456238-e4f3-4dc7-807d-a23eb4faa341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:33.140260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 689/1405] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:33.429939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:33.431503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:33.520813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:33.605723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a31b98-e9df-4790-a208-dc21ad8cbe09 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:33.782668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:33.783481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:33.783976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:33.784772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:33.788059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:33.891138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:33.964799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:33.966430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edbac76-b843-4aab-95e1-7a1b773f72ef service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:33.985093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 717/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:35.948035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:35.948629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:35.948629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:35.949964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 690/1407] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:35.955340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832bb8-f6d0-4694-9e21-bb1ee7258288 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:35.955804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832bb8-f6d0-4694-9e21-bb1ee7258288 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:35.955901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e832bb8-f6d0-4694-9e21-bb1ee7258288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:36.025959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e832bb8-f6d0-4694-9e21-bb1ee7258288 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:36.027198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e832bb8-f6d0-4694-9e21-bb1ee7258288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:36.140560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 718/1408] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:36.429212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:36.431016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:36.526041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:36.602772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ec20cd-ee3a-44b6-861e-7abb645f5efc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:36.732793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:36.733524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:36.733866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:36.734207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:36.736000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:36.789130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:36.847872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:36.849562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82332182-9aa3-41a2-bd18-43c532f11594 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:36.869584 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 691/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:46.134076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:46.867022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=26 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:52.458312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ef12-c0ba-4ad6-98ce-ac6b684e91cc None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:52.458886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ef12-c0ba-4ad6-98ce-ac6b684e91cc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:52.458886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd0ef12-c0ba-4ad6-98ce-ac6b684e91cc None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:52.460216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 719/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu Aug 25 02:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:52.465485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f13-2fc5-4652-89f3-130237a6e814 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:52.465897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f13-2fc5-4652-89f3-130237a6e814 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:52.466025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81750f13-2fc5-4652-89f3-130237a6e814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:52.540310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-81750f13-2fc5-4652-89f3-130237a6e814 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:52.541827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-81750f13-2fc5-4652-89f3-130237a6e814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:52.648575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 692/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 25 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:52.663071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0438c-4483-4c66-bda4-ce8f773aea36 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:52.663349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0438c-4483-4c66-bda4-ce8f773aea36 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:52.663620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0438c-4483-4c66-bda4-ce8f773aea36 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:52.664970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 720/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu Aug 25 02:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:52.669474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9636e1-f059-4d7a-9a13-b18481539b02 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:52.669764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9636e1-f059-4d7a-9a13-b18481539b02 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:52.670072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9636e1-f059-4d7a-9a13-b18481539b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:52.743150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:52.746373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0f9636e1-f059-4d7a-9a13-b18481539b02 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:52.747937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0f9636e1-f059-4d7a-9a13-b18481539b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:52.861993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 693/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu Aug 25 02:49:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:55.248815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:55.249380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:55.249380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:55.250725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:55.258741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43430-11dc-4ec8-93b4-59506931b4d8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:55.259158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43430-11dc-4ec8-93b4-59506931b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:55.259262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a43430-11dc-4ec8-93b4-59506931b4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:55.324593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a4a43430-11dc-4ec8-93b4-59506931b4d8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:55.325709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a4a43430-11dc-4ec8-93b4-59506931b4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:55.379650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:55.422466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:55.712616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:55.714181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:55.859012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49824428-4163-4ac2-bf89-42dfc3042a9d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:55.930905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:55.970677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:55.971202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:55.971477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:55.971743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:55.973348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:56.061112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:56.062736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d121c860-dd4e-4860-97ea-4959e1253a32 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:56.080176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 722/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:56.962688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dea3-8235-4870-b396-240274518420 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:56.963235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dea3-8235-4870-b396-240274518420 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:56.963235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b169dea3-8235-4870-b396-240274518420 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:56.964570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:56.969489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbf48-5e55-490f-8535-899af8c5f10d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:56.969916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbf48-5e55-490f-8535-899af8c5f10d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:56.970041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bbf48-5e55-490f-8535-899af8c5f10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:57.048087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f3bbf48-5e55-490f-8535-899af8c5f10d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:57.049355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f3bbf48-5e55-490f-8535-899af8c5f10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:57.075881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:57.147160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:57.295953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169dea3-8235-4870-b396-240274518420 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:57.297499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b169dea3-8235-4870-b396-240274518420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:57.445362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b169dea3-8235-4870-b396-240274518420 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:57.488509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:57.566370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:57.566889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:57.567165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:57.567434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:57.569060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:57.675205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:57.678008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7ada96-8087-40eb-8695-7211fb232154 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:57.697300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 696/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:49:58.578309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:58.578823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:58.578929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:58.580260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:58.585181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483961a-bc16-4158-be48-3e97dc651efa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:58.585619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483961a-bc16-4158-be48-3e97dc651efa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:58.585726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483961a-bc16-4158-be48-3e97dc651efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:58.638696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:58.659901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3483961a-bc16-4158-be48-3e97dc651efa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:58.661665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3483961a-bc16-4158-be48-3e97dc651efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:58.754571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:49:58.906760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:58.908198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:59.050951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0cc4-02e7-4c8e-932d-7285488720df None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:59.063582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:59.164562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:59.165176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:59.165452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:59.165722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:59.167336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:59.255898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:59.257532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c69bda-6081-4bb4-9331-dbcb0099bb7d service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:59.276136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 725/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:00.138933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:00.139505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:00.139505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:00.140926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:00.146035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118c40-2525-4feb-a973-2fc7b5cf38e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:00.146474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118c40-2525-4feb-a973-2fc7b5cf38e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:00.146571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa118c40-2525-4feb-a973-2fc7b5cf38e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:00.166592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:00.222148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-aa118c40-2525-4feb-a973-2fc7b5cf38e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:00.223366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-aa118c40-2525-4feb-a973-2fc7b5cf38e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:00.319547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:00.470109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:00.471615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:00.582750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:00.619484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f1df0-2616-4162-bc0d-b9a55282654a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:00.731187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:00.731704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:00.731983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:00.732280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:00.733927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:00.808544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:00.822815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:00.824485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58bd18-dac0-4ca1-94f4-6910023f3f58 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:00.842681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 699/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:01.697189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:01.697722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:01.697722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:01.699098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:01.704086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf59c-5139-4a8c-bc8b-281f6b16c277 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:01.704563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf59c-5139-4a8c-bc8b-281f6b16c277 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:01.704690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abf59c-5139-4a8c-bc8b-281f6b16c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:01.783629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a5abf59c-5139-4a8c-bc8b-281f6b16c277 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:01.784882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a5abf59c-5139-4a8c-bc8b-281f6b16c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:01.882093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:02.034077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:02.035523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:02.126623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:02.192474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef225c-2de6-4b4a-bf12-b07e140fed24 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:02.307763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:02.308288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:02.308599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:02.308874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:02.310474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:02.363384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:02.408978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:02.410600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8782c3d-78ae-4a74-97d7-81023f9e85e0 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:02.428148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 728/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:03.224788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:03.225331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:03.225331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:03.226651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:03.231554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511941-d58e-4abd-88fd-2c195129ac08 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:03.231934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511941-d58e-4abd-88fd-2c195129ac08 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:03.232117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32511941-d58e-4abd-88fd-2c195129ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:03.307774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-32511941-d58e-4abd-88fd-2c195129ac08 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:03.309006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-32511941-d58e-4abd-88fd-2c195129ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:03.404104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:50:03.555998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:03.558276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:03.607282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:03.702645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a335fab-0581-4c48-859b-2e486cb0bf45 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:03.816308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:03.816861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:03.817638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:03.817918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:03.819620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:03.827567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:03.909151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:03.910741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0afdcc-c682-4ca9-b50a-6889a3596d8a service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:03.928447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 702/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:04.769493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:04.770065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:04.770065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:04.771410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:04.776672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60cde-cc64-4571-805d-adaf66bd9c7a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:04.777140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60cde-cc64-4571-805d-adaf66bd9c7a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:04.777247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea60cde-cc64-4571-805d-adaf66bd9c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:04.857241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4ea60cde-cc64-4571-805d-adaf66bd9c7a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:04.858449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4ea60cde-cc64-4571-805d-adaf66bd9c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:04.933453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:04.963329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:05.116263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:05.117513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:05.136673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:05.265246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f971e-222b-4862-a6b8-0f5596666589 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:05.351997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:05.378604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:05.379371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:05.380263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:05.380574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:05.382185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:05.471510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:05.473144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c9d2f5-920e-412c-8a60-aebfb3f48bee service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:05.491024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 731/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:06.299253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:06.299791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:06.299791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:06.301192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:06.306761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad574-62d5-4ba7-955a-ceba60e5871c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:06.307213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad574-62d5-4ba7-955a-ceba60e5871c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:06.307321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ad574-62d5-4ba7-955a-ceba60e5871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:06.381794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-974ad574-62d5-4ba7-955a-ceba60e5871c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:06.383013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-974ad574-62d5-4ba7-955a-ceba60e5871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:06.424485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:06.478981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:06.630137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:06.631689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:06.775469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47785f0a-d48f-4733-9d82-f307b92390b4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:06.828655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:06.887895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:06.888528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:06.888807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:06.889078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:06.890663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:06.977303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:06.978887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edde230c-4360-474b-9d2b-9d157ef0d947 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:06.996803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 705/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:07.812028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:07.812628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:07.812628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:07.814014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:07.819257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d83b-c0ee-4497-ac2b-7ce6fd35b538 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:07.819763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d83b-c0ee-4497-ac2b-7ce6fd35b538 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:07.819879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de93d83b-c0ee-4497-ac2b-7ce6fd35b538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:07.894657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-de93d83b-c0ee-4497-ac2b-7ce6fd35b538 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:07.896445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-de93d83b-c0ee-4497-ac2b-7ce6fd35b538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:07.898459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:07.992820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:08.143510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:08.145066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:08.291277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501606b8-8d1f-4010-ba3a-4594902b88e7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:08.317436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:08.404435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:08.404956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:08.405234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:08.405504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:08.407107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:08.495679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:08.497340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418fc02-2871-4fee-971c-3e7e41c0fc7f service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:08.515453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 734/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:10.341218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:10.341834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:10.341834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:10.343113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:10.348520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752949-6cc1-4e05-8338-9cf148f5e4e0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:10.349040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752949-6cc1-4e05-8338-9cf148f5e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:10.349040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b752949-6cc1-4e05-8338-9cf148f5e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:10.393099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:10.419987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8b752949-6cc1-4e05-8338-9cf148f5e4e0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:10.421251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8b752949-6cc1-4e05-8338-9cf148f5e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:10.516723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:10.796712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:10.798251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:10.901146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e3a14-b55b-40ac-b990-ecabb0a045d2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:10.933249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:10.974806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:10.975412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:10.975689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:10.975961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:10.977576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:11.085127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:11.086481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1b464-f1d5-4199-a1e3-6b64bf56abcb service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:11.104012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 708/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:13.146262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:13.146831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:13.146831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:13.148178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:13.153476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f836e-fa93-4586-a81d-4401b0ca0ec6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:13.153909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f836e-fa93-4586-a81d-4401b0ca0ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:13.154019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f836e-fa93-4586-a81d-4401b0ca0ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:13.218642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-792f836e-fa93-4586-a81d-4401b0ca0ec6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:13.219732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-792f836e-fa93-4586-a81d-4401b0ca0ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:13.232210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:13.316762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:13.602907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:13.604549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:13.706404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c68c1-5b1f-4b1f-8d83-1f713c92e5a2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:13.718261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:13.779320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:13.779928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:13.780207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:13.780509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:13.782099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:13.897190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:13.898614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886379d-0ddd-4a90-962b-1afcb9f3c3c6 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:13.916708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 737/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:16.143993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:16.144671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:16.144671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:16.145945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:16.151179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62180-0727-4a09-8885-35042c25123d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:16.151596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62180-0727-4a09-8885-35042c25123d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:16.151738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62180-0727-4a09-8885-35042c25123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:16.200768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:16.218793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-09a62180-0727-4a09-8885-35042c25123d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:16.220017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-09a62180-0727-4a09-8885-35042c25123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:16.314945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:16.603438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:16.605052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:16.707457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67401d3-1d0a-4eb1-a574-8f22a8d601f0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:16.746633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:16.779190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:16.779786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:16.780287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:16.780586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:16.782167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:16.889523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:16.890890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8f843-2995-4813-b2f4-c183372c14bd service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:16.909061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 711/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:18.931847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:18.932450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:18.932450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:18.933814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:18.939250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f8b-2a1e-4b98-b6f5-c957e3c7a19d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:18.939670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f8b-2a1e-4b98-b6f5-c957e3c7a19d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:18.939839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05095f8b-2a1e-4b98-b6f5-c957e3c7a19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:19.006774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-05095f8b-2a1e-4b98-b6f5-c957e3c7a19d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:19.007978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-05095f8b-2a1e-4b98-b6f5-c957e3c7a19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:19.028701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:19.104028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:19.389647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:19.391196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:19.494926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed8d443-9122-4f2b-8618-ec521648d1e1 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:19.514273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:19.568242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:19.568794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:19.569079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:19.569346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:19.570931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:19.678818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:19.680266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92ed34b-1f03-4860-9853-5a9f182dc93c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:19.698373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 740/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:21.657472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:21.657999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:21.657999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:21.659291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:21.665266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747932f-ac9e-4996-afa2-de57928d18d3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:21.665677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747932f-ac9e-4996-afa2-de57928d18d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:21.665822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747932f-ac9e-4996-afa2-de57928d18d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:21.730524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:21.733745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8747932f-ac9e-4996-afa2-de57928d18d3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:21.735376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8747932f-ac9e-4996-afa2-de57928d18d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:21.831808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:22.118291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:22.119836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:22.223803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c6ee5-5b58-4348-aeba-d74222ac4abc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:22.272521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:22.297297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:22.297905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:22.298184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:22.298457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:22.300056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:22.406919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:22.408354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a03cc30-3059-46ee-8f1b-a9565a3b0386 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:22.432929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 714/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:24.477217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:24.477744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:24.477744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:24.479159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:24.484517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c227-0a18-4cdd-a974-212b6a632ad7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:24.484949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c227-0a18-4cdd-a974-212b6a632ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:24.485076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42c227-0a18-4cdd-a974-212b6a632ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:24.550114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5a42c227-0a18-4cdd-a974-212b6a632ad7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:24.551322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5a42c227-0a18-4cdd-a974-212b6a632ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:24.580921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:24.648973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:24.934715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:24.936269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:25.037973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e3784-b21f-4794-abe2-1aa179db8b0f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:25.069860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:25.115799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:25.116421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:25.116705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:25.116982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:25.118581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:25.224901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:25.226254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b02f60-7e08-46a7-91a9-070424e1200e service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:25.244031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 743/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:27.209445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:27.209983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:27.209983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:27.211331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:27.216752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc613e1-1cda-45bc-b551-14972ead7780 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:27.217174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc613e1-1cda-45bc-b551-14972ead7780 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:27.217285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc613e1-1cda-45bc-b551-14972ead7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:27.283845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-abc613e1-1cda-45bc-b551-14972ead7780 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:27.284851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-abc613e1-1cda-45bc-b551-14972ead7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:27.294137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:27.384964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:27.670304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:27.671820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:27.773535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950efa85-a779-4b0a-8558-c0e0cf2f929b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:27.826745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:27.845498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:27.846095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:27.846370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:27.846637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:27.848218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:27.955021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:27.956375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b06ee3-970a-48e0-8a5d-774dfc345074 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:27.974690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 717/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:29.913204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:29.913772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:29.913772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:29.915099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:29.920491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e36b5-ccb1-4da4-bd03-7ee2a82c868c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:29.920892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e36b5-ccb1-4da4-bd03-7ee2a82c868c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:29.921062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e36b5-ccb1-4da4-bd03-7ee2a82c868c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:29.985722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d29e36b5-ccb1-4da4-bd03-7ee2a82c868c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:29.986909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d29e36b5-ccb1-4da4-bd03-7ee2a82c868c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:30.024874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:30.082892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:30.365513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:30.367177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:30.470734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf504d-c2f2-43f6-a2f3-9cf810079ba7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:30.512637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:30.549844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:30.550454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:30.550736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:30.551160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:30.553271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:30.660295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:30.662224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea88bba-a459-4719-a87c-d32f3d7fbdf2 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:30.680464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 746/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:32.592274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:32.592727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:32.592975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:32.594547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:32.600130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b8f80-2bea-490e-bf47-d75128eed5d4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:32.600593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b8f80-2bea-490e-bf47-d75128eed5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:32.600690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b8f80-2bea-490e-bf47-d75128eed5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:32.666361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cb9b8f80-2bea-490e-bf47-d75128eed5d4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:32.667570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cb9b8f80-2bea-490e-bf47-d75128eed5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:32.685925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:32.764845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:33.050861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:33.052498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:33.155798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0de9ba-6a81-4761-8d68-31509f40db48 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:33.228682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:33.235765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:33.236364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:33.236673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:33.236942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:33.238791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:33.344050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:33.345567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e31b74-2498-4e4b-9818-9159f6983f11 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:33.364034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 720/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:35.318464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:35.318951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:35.318951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:35.320287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:35.325664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa18ba-e437-4d88-ba64-4cfcb38819fa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:35.326087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa18ba-e437-4d88-ba64-4cfcb38819fa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:35.326227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa18ba-e437-4d88-ba64-4cfcb38819fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:35.395187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e2aa18ba-e437-4d88-ba64-4cfcb38819fa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:35.396426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e2aa18ba-e437-4d88-ba64-4cfcb38819fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:35.444315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:35.491888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:50:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:35.780381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:35.781985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:35.888186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c167f7f-2550-4ca1-9918-2db80dc42584 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:35.934789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:35.960927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:35.961528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:35.961804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:35.962281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:35.963897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:36.192775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:36.194211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095a5efd-ed3e-481a-ba15-78ffaa190c19 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:36.213899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 749/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:45.490296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=22 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:46.211343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=66 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:55.590295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d893-4424-4c32-8cb3-6bbd38fe211a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:55.590853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d893-4424-4c32-8cb3-6bbd38fe211a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:55.590853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc64d893-4424-4c32-8cb3-6bbd38fe211a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:55.592280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 722/1471] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:55.597797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87efa9-fe4b-4c65-9524-437f95c6df44 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:55.598230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87efa9-fe4b-4c65-9524-437f95c6df44 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:55.598353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87efa9-fe4b-4c65-9524-437f95c6df44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:55.665572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ac87efa9-fe4b-4c65-9524-437f95c6df44 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:55.666785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac87efa9-fe4b-4c65-9524-437f95c6df44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:55.759860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 750/1472] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:56.060559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.060559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.060559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.060559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 723/1473] 10.222.0.64 () {54 vars in 967 bytes} [Thu Aug 25 02:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:56.065232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea067-ea03-46cf-a8d7-d3f742302b8c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.065529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea067-ea03-46cf-a8d7-d3f742302b8c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.065807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ea067-ea03-46cf-a8d7-d3f742302b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.140266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f81ea067-ea03-46cf-a8d7-d3f742302b8c None None] MFA Rules not processed for user `bf080f10671b4fd8aaf6e232d5f8b2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:56.141504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f81ea067-ea03-46cf-a8d7-d3f742302b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:56.162134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.216716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 751/1474] 10.222.0.64 () {58 vars in 1064 bytes} [Thu Aug 25 02:50:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:56.224688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.226229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:56.328875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cea7db-ffde-49e6-b1c6-f228b389d8a9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.406941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.407557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.407835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.408105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.409742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:56.465208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.520796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.522241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874000b3-c46d-472d-a2f8-c1767bc1d515 service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.541101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 724/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:50:58.521746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:58.522318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:58.522318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:58.523641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 752/1476] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:58.528843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3570d-0254-4ddd-9a3a-c3b9b352f8ee None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:58.529237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3570d-0254-4ddd-9a3a-c3b9b352f8ee None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:58.529386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e3570d-0254-4ddd-9a3a-c3b9b352f8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:58.593388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e8e3570d-0254-4ddd-9a3a-c3b9b352f8ee None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:58.594594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e8e3570d-0254-4ddd-9a3a-c3b9b352f8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:58.687813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 725/1477] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:50:58.963114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:58.964612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:59.086365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d9160-f780-4f4f-b37e-f45680085a26 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:59.135330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:59.179354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:59.179952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:59.180231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:59.180531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:59.181167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:59.182889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:50:59.182889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:50:59.182889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:50:59.184007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b80587-c949-444a-aaa8-35bde3867511 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:59.202382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 753/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:58 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:51:01.117508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.118089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.118089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.119445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 726/1479] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:01.124597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031005ec-2543-465b-9002-90a0e08ddfef None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.125009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031005ec-2543-465b-9002-90a0e08ddfef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.125132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031005ec-2543-465b-9002-90a0e08ddfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.191037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-031005ec-2543-465b-9002-90a0e08ddfef None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:01.192268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-031005ec-2543-465b-9002-90a0e08ddfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:01.286227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 754/1480] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:51:01.576924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.578549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:01.589104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:01.723884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f03fb93-7e8d-4098-9918-f7f1763501ff None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:01.803118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:01.835481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:01.836081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.836355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.836649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.838227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:01.926959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:01.928600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4597df-d8a4-48ee-b3c2-21406f363a6a service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:01.946356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 727/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:51:04.030879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:04.031364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:04.031463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:04.032838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 755/1482] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:04.041264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044a27-c52a-4cf9-b853-6bd8ad86bee4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:04.041729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044a27-c52a-4cf9-b853-6bd8ad86bee4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:04.041876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3044a27-c52a-4cf9-b853-6bd8ad86bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:04.109359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b3044a27-c52a-4cf9-b853-6bd8ad86bee4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:04.110590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b3044a27-c52a-4cf9-b853-6bd8ad86bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:04.169755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:04.226872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 728/1483] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:51:04.530135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:04.531691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:04.555805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:04.638574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d7d35-4c0b-4d42-bc68-31e196af7db5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:04.716957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:04.717552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:04.717833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:04.718095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:04.719665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:04.794396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:04.830919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:04.832361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2413e8-8f2b-4991-8c38-f4f24bd91f8e service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:04.850530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 756/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:51:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:51:06.820864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.821430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.821544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.822818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 729/1485] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:06.828099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee391-9e5b-4f16-8d7f-6a8655da4f41 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.828524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee391-9e5b-4f16-8d7f-6a8655da4f41 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.828680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ee391-9e5b-4f16-8d7f-6a8655da4f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.892275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-012ee391-9e5b-4f16-8d7f-6a8655da4f41 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:06.893502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-012ee391-9e5b-4f16-8d7f-6a8655da4f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:06.988436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 757/1486] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:51:07.278795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:07.280332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:07.383243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfe4a50-069b-4996-90bf-4f158f8ad096 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:07.454769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:07.456763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:07.457514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:07.458033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:07.458488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:07.460245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:07.567873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:07.569252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13207f9-b179-47b4-a168-cbb00c2be12c service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:07.587501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 730/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:51:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:51:09.595261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.595787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.595787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.597140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 758/1488] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:09.602555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d6af-3266-428b-aaa6-b907518901ae None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.602999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d6af-3266-428b-aaa6-b907518901ae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.603105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404d6af-3266-428b-aaa6-b907518901ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.668385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d404d6af-3266-428b-aaa6-b907518901ae None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:09.669613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d404d6af-3266-428b-aaa6-b907518901ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:09.721758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:09.767260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 731/1489] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:51:10.059746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.061337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:10.097180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.166246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04c9c9-5e0b-4536-a738-90b668cfaa24 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.239435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.240030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.240304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.240608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.242183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:10.320789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.350376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.351825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a880fcc-e93a-4675-881a-b001dc51be22 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.370742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 759/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:51:12.443913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:12.444498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:12.444498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:12.445836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 732/1491] 10.222.0.64 () {54 vars in 927 bytes} [Thu Aug 25 02:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:12.451192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465db-db8a-4840-93b7-ff7d46a66fd3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:12.451593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465db-db8a-4840-93b7-ff7d46a66fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:12.451745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4465db-db8a-4840-93b7-ff7d46a66fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:12.516715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-da4465db-db8a-4840-93b7-ff7d46a66fd3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:12.517933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-da4465db-db8a-4840-93b7-ff7d46a66fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:12.615443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 760/1492] 10.222.0.64 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:51:12.905409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:12.906987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:13.009243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a7f9-3256-49b8-bb84-597f7bb35b86 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:13.082815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:13.083415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.083693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.083965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.085587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:13.094607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:13.194565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:13.196005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d19ac2-e499-45ff-9c6b-e08acfbf1e38 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:13.213518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 733/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:51:22.613408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:23.211308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=50 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:45.057597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.058226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.058226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.134675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:45.135925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.231893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 761/1494] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:45.240351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.240872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.240983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.316491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:45.317630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.415827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 734/1495] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:45.420474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:45.421683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.433104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99acf44-9ef7-4e17-a0ab-ba517c746851 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:45.494862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:45.528782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:45.529391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.529665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.529929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.530561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:52:45.530862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:45.531866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:45.531866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:52:45.531866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:52:45.532780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:45.543842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 762/1496] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:52:45.552150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:45.561435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97bded2-18c8-4df4-a096-0578816993c3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:45.622201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:45.656761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:45.657365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.657641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.657910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.658534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:45.660339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:45.660339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:52:45.660339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:52:45.661559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:45.716225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 735/1497] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:52:45 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:52:45.720570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:45.722641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.756830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a5c7f-414c-4223-8203-c8b243085c3b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:45.851838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:45.852468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.852746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.853011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.853633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:45.854632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:45.854632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:52:45.854632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:52:45.855825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:45.898959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 763/1498] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:52:45 2022] POST /identity/v3/users => generated 290 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:52:45.902942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:45.904552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.964659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a59e2d-629d-4b4b-9725-36c83c80564d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:46.044747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:46.057179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:46.057788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.058067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.058340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.058981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:46.059992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:46.059992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:52:46.059992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:52:46.060950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:46.073767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 736/1499] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:52:46.077984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:46.079506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.090857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd216d-f957-4c06-ac1e-4a715512e84a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:46.116759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:46.186804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:46.187415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.187691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.187960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.188621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:46.189647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:46.189647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:52:46.189647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:52:46.190527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332bcc9-3069-4fde-acd5-678b3881f4ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:46.202552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 764/1500] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:52:46 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:52:46.207802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:46.211015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.245451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206a5c6-9913-4169-a4c1-b4f1e3b3085f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:46.456837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:46.457421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.457699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.457971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] PATH_INFO: `/v3/projects/c0a859989d654055af34e26e0e058161/users/243657eee74446ffba4e2c5b1eb30352/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.479758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a859989d654055af34e26e0e058161, user_id=243657eee74446ffba4e2c5b1eb30352, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:46.480820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:46.480820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:52:46.480820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:52:46.482736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb490f9-b9e6-4ee1-a859-145a98abadeb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:46.506718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 737/1501] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:52:46 2022] PUT /identity/v3/projects/c0a859989d654055af34e26e0e058161/users/243657eee74446ffba4e2c5b1eb30352/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:52:46.519277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4a1d-a597-4bb8-af63-0c53249dd483 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.519610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4a1d-a597-4bb8-af63-0c53249dd483 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.519894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce4a1d-a597-4bb8-af63-0c53249dd483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.575328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-09ce4a1d-a597-4bb8-af63-0c53249dd483 None None] MFA Rules not processed for user `243657eee74446ffba4e2c5b1eb30352`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:46.576590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-09ce4a1d-a597-4bb8-af63-0c53249dd483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.654000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 765/1502] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:46.667768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.668053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.668325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.669691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 738/1503] 10.222.0.64 () {54 vars in 964 bytes} [Thu Aug 25 02:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:46.674276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c270c-b2da-4ca1-8745-abb64adea9f8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.674568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c270c-b2da-4ca1-8745-abb64adea9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.674845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c270c-b2da-4ca1-8745-abb64adea9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.705414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:46.749353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-972c270c-b2da-4ca1-8745-abb64adea9f8 None None] MFA Rules not processed for user `23232654097d435a9ebe540ada43804d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:46.750499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-972c270c-b2da-4ca1-8745-abb64adea9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.826241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 766/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Thu Aug 25 02:52:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:46.834258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:46.835760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.885272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:46.938009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3c2a3-8227-4c87-8da9-99e8618fb072 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:47.009495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:47.010019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:47.010294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:47.010562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:47.012143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:47.106841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:47.108267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:47.112055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:47.127962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 739/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:47.172692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c8af-cc18-4331-96db-0c92acf76676 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:47.173149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c8af-cc18-4331-96db-0c92acf76676 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:47.173256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c08c8af-cc18-4331-96db-0c92acf76676 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:47.174529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 767/1506] 10.222.0.64 () {52 vars in 830 bytes} [Thu Aug 25 02:52:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:47.178112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:47.179330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:47.278567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b18da-367c-4c6d-b423-0a7ab0f5bca3 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:47.370888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:47.371532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:47.371807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:47.372077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] PATH_INFO: `/v3/users/243657eee74446ffba4e2c5b1eb30352` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:47.385653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=243657eee74446ffba4e2c5b1eb30352)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:47.386685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:47.386685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:52:47.386685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:52:47.387897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:47.397442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:47.453855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '243657eee74446ffba4e2c5b1eb30352'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:47.454388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '243657eee74446ffba4e2c5b1eb30352'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:47.463152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '243657eee74446ffba4e2c5b1eb30352'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:47.477291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '243657eee74446ffba4e2c5b1eb30352'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:47.500249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '243657eee74446ffba4e2c5b1eb30352'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:47.506314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 740/1507] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:52:47 2022] DELETE /identity/v3/users/243657eee74446ffba4e2c5b1eb30352 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:52:47.510763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:47.511052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:47.511330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:47.566686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:47.567815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:47.641649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:47.654453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 768/1508] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:47.664650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:47.665883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:47.765347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf68b9-889d-4e4d-8a22-d971e461a8a1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:47.821150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:47.842096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:47.842709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:47.843006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:47.843278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:47.844885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:47.951194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:47.952664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6289709c-e1d3-4afe-bf60-719c5acb291b service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:47.971851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 741/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:48.293288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:48.294527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:48.306445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d275c-58b1-413d-861b-2365902a1390 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:48.406900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:48.407561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:48.407873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:48.408172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] PATH_INFO: `/v3/projects/c0a859989d654055af34e26e0e058161` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:48.418076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a859989d654055af34e26e0e058161)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:48.419106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:52:48.419106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:52:48.419106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:52:48.420318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:48.478933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a859989d654055af34e26e0e058161', 'request_id': 'req-6be34f2e-7fff-454d-8d2f-634a6a675693'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:48.484807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a859989d654055af34e26e0e058161', 'request_id': 'req-6be34f2e-7fff-454d-8d2f-634a6a675693'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:48.494708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a859989d654055af34e26e0e058161', 'request_id': 'req-6be34f2e-7fff-454d-8d2f-634a6a675693'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:48.525122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] The token cache is being invalidate because project c0a859989d654055af34e26e0e058161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:52:48.525415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:48.525944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6be34f2e-7fff-454d-8d2f-634a6a675693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:52:48.527258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 769/1510] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:52:48 2022] DELETE /identity/v3/projects/c0a859989d654055af34e26e0e058161 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:52:57.968978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=62 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:58.523315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:31.104174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:31.104834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:31.104834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:31.106119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:31.111335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8d48-20f0-4d91-94a5-bd90b7f6bb77 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:31.111801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8d48-20f0-4d91-94a5-bd90b7f6bb77 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:31.111902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9c8d48-20f0-4d91-94a5-bd90b7f6bb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:31.193610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e9c8d48-20f0-4d91-94a5-bd90b7f6bb77 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:31.194820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e9c8d48-20f0-4d91-94a5-bd90b7f6bb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:31.297719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:31.452426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:31.455159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:31.574390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2302b8-f3f1-4950-be2e-dad1593a71ec None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:31.579899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:31.580548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:31.580822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:31.581096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:31.589131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:31.590710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d61f22-578e-4fd3-b805-76043b87b313 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:31.599914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 743/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:32.327111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a65799-b1a4-4b74-8c5e-a6ffdf588c7b None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:32.327677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a65799-b1a4-4b74-8c5e-a6ffdf588c7b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:32.327677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a65799-b1a4-4b74-8c5e-a6ffdf588c7b None None] PATH_INFO: `/v3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:32.329040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 771/1514] 10.222.0.47 () {54 vars in 925 bytes} [Thu Aug 25 02:54:32 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:54:32.335829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb6d6b-d99b-4f25-a31d-7f76d908ffed None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:32.336263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb6d6b-d99b-4f25-a31d-7f76d908ffed None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:32.336371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb6d6b-d99b-4f25-a31d-7f76d908ffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:32.401081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8efb6d6b-d99b-4f25-a31d-7f76d908ffed None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:32.402444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8efb6d6b-d99b-4f25-a31d-7f76d908ffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:32.420912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18f87-d849-43b9-90d5-0f8a09ef12d2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:32.421196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18f87-d849-43b9-90d5-0f8a09ef12d2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:32.421470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e18f87-d849-43b9-90d5-0f8a09ef12d2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:32.422806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 772/1515] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:54:32.427137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:32.427422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:32.427700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:32.446629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:32.447838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:32.456657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 773/1516] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:54:32.471435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:32.476884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 744/1517] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 25 02:54:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:32.609903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:32.622464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354dc5c2-055a-47ba-be80-b556e486f9b8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:32.628517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c320667-6226-428a-a083-212140b454a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:32.629115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320667-6226-428a-a083-212140b454a3 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:32.629397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320667-6226-428a-a083-212140b454a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:32.629670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c320667-6226-428a-a083-212140b454a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:32.637637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c320667-6226-428a-a083-212140b454a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:32.639859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c320667-6226-428a-a083-212140b454a3 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:32.649180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 774/1518] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:41.536209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168a3-c7d8-44c2-8a3d-897d7c60ff68 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:41.536840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168a3-c7d8-44c2-8a3d-897d7c60ff68 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:41.536840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb168a3-c7d8-44c2-8a3d-897d7c60ff68 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:41.538017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 745/1519] 10.222.0.64 () {54 vars in 961 bytes} [Thu Aug 25 02:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:41.543362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf2fc-1501-47e1-bf6e-7d429ba379f2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:41.543796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf2fc-1501-47e1-bf6e-7d429ba379f2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:41.543906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fcf2fc-1501-47e1-bf6e-7d429ba379f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:41.564191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-66fcf2fc-1501-47e1-bf6e-7d429ba379f2 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:41.565417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-66fcf2fc-1501-47e1-bf6e-7d429ba379f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:41.573892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 775/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Aug 25 02:54:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:41.581437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb168a3-c7d8-44c2-8a3d-897d7c60ff68 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:41.594522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb168a3-c7d8-44c2-8a3d-897d7c60ff68 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:41.599875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:41.600489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:41.600766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:41.601037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:41.609750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:41.612204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed01fc4-5f5e-4151-b7ea-4ec32f600333 service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:41.622121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 746/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:43.878713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bba44-e6ba-4fef-b54d-f16cf4a9ba15 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:43.879250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bba44-e6ba-4fef-b54d-f16cf4a9ba15 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:43.879250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bba44-e6ba-4fef-b54d-f16cf4a9ba15 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:43.880544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:43.885394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1e9e-b09d-4ad5-af76-42aec9bf7058 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:43.885842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1e9e-b09d-4ad5-af76-42aec9bf7058 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:43.885947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa1e9e-b09d-4ad5-af76-42aec9bf7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:43.905603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-89fa1e9e-b09d-4ad5-af76-42aec9bf7058 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:43.906800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89fa1e9e-b09d-4ad5-af76-42aec9bf7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:43.914878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:44.069349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bba44-e6ba-4fef-b54d-f16cf4a9ba15 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:44.084218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bba44-e6ba-4fef-b54d-f16cf4a9ba15 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:44.089662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:44.090249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:44.090525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:44.090793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:44.098640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:44.100202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a42aacb-53c9-4151-bc9a-04e963b21a2c service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:44.109376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 777/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:44.935396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feefe9-81f9-4f1e-b4ee-20a3b53b1b24 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:44.935965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feefe9-81f9-4f1e-b4ee-20a3b53b1b24 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:44.935965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77feefe9-81f9-4f1e-b4ee-20a3b53b1b24 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:44.937318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:44.942618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885f11-08d5-4b6b-a7e4-0a9529f92aef None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:44.943055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885f11-08d5-4b6b-a7e4-0a9529f92aef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:44.943191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82885f11-08d5-4b6b-a7e4-0a9529f92aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:44.962353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-82885f11-08d5-4b6b-a7e4-0a9529f92aef None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:44.963549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-82885f11-08d5-4b6b-a7e4-0a9529f92aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:44.971494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:45.124471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feefe9-81f9-4f1e-b4ee-20a3b53b1b24 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:45.139193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77feefe9-81f9-4f1e-b4ee-20a3b53b1b24 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:45.144970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:45.145559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:45.145839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:45.146110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:45.153979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:45.155550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c81cf-4e3e-4bd2-8854-4185544079be service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:45.164846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 749/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:49.042951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:49.043519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:49.043519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:49.044975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:49.051098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719634a-c42b-47d8-8599-e057d720a029 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:49.051564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719634a-c42b-47d8-8599-e057d720a029 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:49.051660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7719634a-c42b-47d8-8599-e057d720a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:49.070384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7719634a-c42b-47d8-8599-e057d720a029 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:49.071578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7719634a-c42b-47d8-8599-e057d720a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:49.079370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:54:49.374779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:49.376533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:49.404174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:49.458779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78175a7-8745-49a5-93c9-48aaceddba18 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:49.462363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:49.462964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:49.463242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:49.463516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:49.472912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:49.474342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a7c49-859d-4615-888d-414fdedc99ce service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:49.483518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 780/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:51.378212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260492d-afcc-4608-991b-f9e4b9a2483f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:51.378760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260492d-afcc-4608-991b-f9e4b9a2483f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:51.378760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8260492d-afcc-4608-991b-f9e4b9a2483f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:51.380256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:51.385729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7fcd-3b55-4f00-8dfd-3dd1c657fb7e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:51.386153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7fcd-3b55-4f00-8dfd-3dd1c657fb7e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:51.386298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b7fcd-3b55-4f00-8dfd-3dd1c657fb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:51.405430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5b7b7fcd-3b55-4f00-8dfd-3dd1c657fb7e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:51.406655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5b7b7fcd-3b55-4f00-8dfd-3dd1c657fb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:51.415246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:51.700209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260492d-afcc-4608-991b-f9e4b9a2483f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:51.711113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8260492d-afcc-4608-991b-f9e4b9a2483f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:51.714600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:51.715195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:51.715499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:51.715753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:51.724673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:51.726107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cf9e9-fc8a-419c-a088-e86e91848999 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:51.737081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 752/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:55.165010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:55.165575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:55.165575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:55.166890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:55.172229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29e1e-8db7-4f9e-815d-364444654387 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:55.172701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29e1e-8db7-4f9e-815d-364444654387 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:55.173443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29e1e-8db7-4f9e-815d-364444654387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:55.192443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1ba29e1e-8db7-4f9e-815d-364444654387 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:55.193650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1ba29e1e-8db7-4f9e-815d-364444654387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:55.202028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:55.754061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:55.755755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:55.833703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8c915-56cf-4d34-8211-e18f39a65ac2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:55.837268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:55.837867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:55.838146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:55.838419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:55.847335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:55.848853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d5a17-dd84-4b1f-9403-5e9299594408 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:55.858468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 783/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:57.771595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:57.772166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:57.772166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:57.773537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:57.778714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ae80-246b-4df3-9511-359ba3496f24 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:57.779144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ae80-246b-4df3-9511-359ba3496f24 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:57.779269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7ae80-246b-4df3-9511-359ba3496f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:57.799128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6fe7ae80-246b-4df3-9511-359ba3496f24 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:57.800331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6fe7ae80-246b-4df3-9511-359ba3496f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:57.808068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:58.352712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:58.354407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:58.368812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87349b-b64f-41ea-8aac-13e0cb1357f2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:58.372235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:58.372858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:58.373137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:58.373407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:58.382235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:58.383689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe94fb-cbbc-4f97-b914-5c94f32b864f service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:58.394298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 755/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:07.793619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=66 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:08.389374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=34 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:32.698977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:32.699642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:32.699642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:32.727228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:32.728473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:32.740777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 785/1540] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:32.749889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:32.750447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:32.750447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:32.779398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:32.780714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:32.790820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 756/1541] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:32.795512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:32.810717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8e36e-71a5-403b-a6d1-c68e613fd9de None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:32.818263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:32.818896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:32.819178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:32.819453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:32.820109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:32.820425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:32.822036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b9836-e715-4586-b776-f1112582a6da admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:32.838672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 786/1542] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:32.846519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:32.861335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7993b-6cf6-45bd-80d6-f36f00e03135 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:32.873013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:32.873637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:32.873917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:32.874188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:32.874849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:32.876870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:32.917513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92ea4-d965-40e0-82e3-05f3133b97b2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:32.917874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92ea4-d965-40e0-82e3-05f3133b97b2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:32.918315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f92ea4-d965-40e0-82e3-05f3133b97b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:32.937285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 757/1543] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:32 2022] POST /identity/v3/projects => generated 379 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:56:32.941368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:32.956005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f0f92ea4-d965-40e0-82e3-05f3133b97b2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:32.957698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f0f92ea4-d965-40e0-82e3-05f3133b97b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.055068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c54dd1-649d-4894-9add-b93346eb2394 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.061115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.062167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.062670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.063170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.064204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.065509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:33.065509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:56:33.065509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:56:33.067158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f382412-e1d1-4409-9fde-2d75b15e8978 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.075938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 787/1544] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.077340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c789-4d1e-4567-8248-77450c474f8c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.077699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c789-4d1e-4567-8248-77450c474f8c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.077985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8c789-4d1e-4567-8248-77450c474f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.113204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 758/1545] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:32 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:56:33.113204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a35a-e2aa-4d0e-a335-0ce3944c2a62 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.113204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a35a-e2aa-4d0e-a335-0ce3944c2a62 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.113204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b4a35a-e2aa-4d0e-a335-0ce3944c2a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.124920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b7d8c789-4d1e-4567-8248-77450c474f8c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.126285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b7d8c789-4d1e-4567-8248-77450c474f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.139207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 788/1546] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.140808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee18b-1388-497c-921b-5a81889cdea2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.141092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee18b-1388-497c-921b-5a81889cdea2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.141363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bee18b-1388-497c-921b-5a81889cdea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.148592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-89b4a35a-e2aa-4d0e-a335-0ce3944c2a62 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.150010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89b4a35a-e2aa-4d0e-a335-0ce3944c2a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.163431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-21bee18b-1388-497c-921b-5a81889cdea2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.170068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-21bee18b-1388-497c-921b-5a81889cdea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.170241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 759/1547] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.170440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.170737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.171009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.184480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 789/1548] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.186370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e8859-e928-4bc9-9e0d-b31eefa4ddef None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.187597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e8859-e928-4bc9-9e0d-b31eefa4ddef None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.187956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e8859-e928-4bc9-9e0d-b31eefa4ddef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.200648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.201685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.209573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-983e8859-e928-4bc9-9e0d-b31eefa4ddef None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.210640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-983e8859-e928-4bc9-9e0d-b31eefa4ddef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.211315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 760/1549] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.211958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.223219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c365c51b-0653-4e4c-a6ac-9de2f4a178b9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.227969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.228609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.228893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.229163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.229719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 790/1550] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.229934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.231531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eae202-926e-4940-9dae-ea537a26b9fb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.235707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34894-6636-4efa-bb12-0947f4a6ca28 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.236013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34894-6636-4efa-bb12-0947f4a6ca28 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.236269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a34894-6636-4efa-bb12-0947f4a6ca28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.245866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 761/1551] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:33.245866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cf95-d87c-4e7f-a157-ec2d7a9e12a9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.245866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cf95-d87c-4e7f-a157-ec2d7a9e12a9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.245866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018cf95-d87c-4e7f-a157-ec2d7a9e12a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.262984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-85a34894-6636-4efa-bb12-0947f4a6ca28 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.264214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-85a34894-6636-4efa-bb12-0947f4a6ca28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.266269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6018cf95-d87c-4e7f-a157-ec2d7a9e12a9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.267438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6018cf95-d87c-4e7f-a157-ec2d7a9e12a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.272475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 791/1552] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.273595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997398f8-8c71-4279-9cb8-6c1f2984f696 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.273875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997398f8-8c71-4279-9cb8-6c1f2984f696 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.274141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997398f8-8c71-4279-9cb8-6c1f2984f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.276343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 762/1553] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.277423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.277708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.277983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.298679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-997398f8-8c71-4279-9cb8-6c1f2984f696 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.299890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-997398f8-8c71-4279-9cb8-6c1f2984f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.300730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.302709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.312705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 792/1554] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.312705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.312705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.312705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.315607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 763/1555] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.316311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.327400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e36efb-34ea-4726-9e7c-eb0a50f61c7d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.332299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.332504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.332972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.333253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.333525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.333638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.334189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.334499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.335509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:33.335509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:56:33.335509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:56:33.336417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577286fb-573f-42dc-8fab-b0f9b8db5c80 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.345983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 793/1556] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.346781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.351446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 764/1557] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.352860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466dff-d8cd-4ada-ba79-108b7116e7be None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.353145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466dff-d8cd-4ada-ba79-108b7116e7be None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.353413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53466dff-d8cd-4ada-ba79-108b7116e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.359084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ad87d-af30-48c0-b733-6162dfd8cec6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.363531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.364142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.364513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.364794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.365434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.367053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.375273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-53466dff-d8cd-4ada-ba79-108b7116e7be None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.376563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-53466dff-d8cd-4ada-ba79-108b7116e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.377211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 794/1558] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:33.378689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.388826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166fa57a-5c5e-4601-83ec-7dbf288db57a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.389364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 765/1559] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.390693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.390978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.391248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.396378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.397018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.397300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.397574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.398311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.398616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.400504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.411155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.412372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.414086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 795/1560] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.414908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.426286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241f9ee-8f3b-49c4-9ca7-4f33eac7d946 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.430448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 766/1561] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.430448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.434461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.435184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.435528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.435872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.436620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.437006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.437403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a18e7c-058d-40b3-a6a4-d11b68c9efcb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.438680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.442285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110576-c970-407f-9452-dbea7641889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.442935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110576-c970-407f-9452-dbea7641889c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.443219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110576-c970-407f-9452-dbea7641889c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.443490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23110576-c970-407f-9452-dbea7641889c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.444131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110576-c970-407f-9452-dbea7641889c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.444457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110576-c970-407f-9452-dbea7641889c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.446042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23110576-c970-407f-9452-dbea7641889c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.457345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 796/1562] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.457345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.458730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 767/1563] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.466605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110576-c970-407f-9452-dbea7641889c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.466741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbfec8-d28b-4995-a594-a03fe767e595 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.470627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.471233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.471514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.471790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.472462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.472772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.474694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.475837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23110576-c970-407f-9452-dbea7641889c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.480409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.481006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.481284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.482751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.483036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.484942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcb2e60-1cb8-4619-8fa7-be3adc351381 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.487464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 797/1564] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.488256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.498032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48ab88-8ee3-4cf6-8138-2dbec8250956 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.502634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.503274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.503556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.503833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] PATH_INFO: `/v3/projects/a3e11c787c1741159db33aa4d9723bed/users/58f1742030694f7d8203b220c485a7d2/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.521928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 768/1565] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.522145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3e11c787c1741159db33aa4d9723bed, user_id=58f1742030694f7d8203b220c485a7d2, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.522250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.522340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:33.522340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:56:33.522340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:56:33.522572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.522572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.522743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.536155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 798/1566] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:33 2022] PUT /identity/v3/projects/a3e11c787c1741159db33aa4d9723bed/users/58f1742030694f7d8203b220c485a7d2/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:33.537065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.541438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.542670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.552762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:33.567795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:33.601076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591e32cb-5771-4483-b856-568b03550edc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.605618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.606213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.606419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 769/1567] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.607182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.608257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.611132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.611775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.612833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:33.612833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:56:33.612833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:56:33.614031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.622563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e2221a-50c2-4975-86d3-44152984b3db None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.628800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.629427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.629713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.629989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.630738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.630946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.632665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.644991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 770/1568] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.645669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.657000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 799/1569] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.657252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78966eb0-fd40-4fe4-a93b-ba6e6cdd1b76 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.658353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.725666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.726138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde5045-5633-4b12-a1b2-22c4c7222435 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.726618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.726618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.726803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.727334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.729280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.731029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.731636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.731914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.732190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.733104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.735035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.758017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 771/1570] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 393 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.759570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.762169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 800/1571] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.764075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.822662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c2090-7d89-47af-9e33-aab7395f65e6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.826950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fa7f6-0585-48c3-bc9f-c2f853991310 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.828031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.828682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.828961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.829234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.829856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.831516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.831768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaf5b7-512c-46ef-b2f1-3ab96080480b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.832121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.832457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.832816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.833643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.835308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.858365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 801/1572] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.860626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 772/1573] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:33.862480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.866028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.866317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.866587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.873918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f741f4-8e5f-4747-9303-19c2f44ca4fb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.888409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:33.889694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:33.894890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:33.901233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:33.935827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.936477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.936763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.937037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.937684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:33.937990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.939595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.951673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 773/1574] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:33.952818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.954009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 802/1575] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:33.955298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:33.970395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6d040-4d6b-4d3a-a626-966fc9660f76 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.971414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd6dc4-7d80-4ddf-a1b0-4b55da113192 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:33.975112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.975805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.975975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:33.976113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.976287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.976583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:33.976867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:33.976974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.977139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:33.977750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:33.978865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:33.979660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.005847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 803/1576] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/users => generated 287 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.005847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.012242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 774/1577] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:33 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.013685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d850899-63a9-49a3-8699-39fd91b11d41 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.013940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.075940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.076601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.076884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.077162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.077790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.079729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.086675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113e386-d7f4-482a-9a97-7d06466fc57f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.092002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.092700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.092956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.093237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.093856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.095782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.105121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 804/1578] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.105121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.115105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eaa204-f39f-436c-b680-cbc736ae6ae7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.118930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 775/1579] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.119722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.123028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.123648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.124003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.124334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.125026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.127070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.131411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e7f55-9de8-4bf0-a159-7fc51f49a70d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.136249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.136909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.137191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.137465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.138531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 805/1580] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.138725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.139320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.140793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.148946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9e7f5-d355-4b61-8d80-c754383c7c1f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.154366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.155111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.155404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.155825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.156554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.158461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.166283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 776/1581] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.166283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.166283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:34.190828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 806/1582] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.190828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.229729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55893998-c52e-4a58-85e3-732117da28a0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.242382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:34.252006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cf8bfa-62b0-4f95-baba-ae5c68c5758c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.256691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.257298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.257579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.257852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.258494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.260119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.261361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:34.271609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 807/1583] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.272486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.280519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.281276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.281548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.281820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.282690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08980ef6-c807-4049-8056-921453c35364 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.287435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.288012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.288293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.288597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.289212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.291039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.291167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.292630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.302373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 777/1584] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:34.303039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.313146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c458208a-d72f-4779-a34a-4e3ba9b18561 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.315225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 808/1585] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/users => generated 294 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.318465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.319073 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.319349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.319466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.319731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.320246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.321865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.331816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5c3770-c73d-45a7-ae76-29b6f08c19ec admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.337451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.338020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 778/1586] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.338139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.338328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.338597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.338900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.339300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.340889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.350396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d030e-1ca5-4c13-9613-d7b7c745fb5f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.351926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 809/1587] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.351926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.358569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.359270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.359697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.360096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.360962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.362562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.366188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b49808-a89e-4691-8dae-b0db5320b979 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.373404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.374009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.374460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 779/1588] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.375345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.376860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.377613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.379100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.382215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.385671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad31658-a3a2-4346-bae0-6926c8da8cef admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.391674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.392353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.392616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.392895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.393526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.395465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.403711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 810/1589] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.406396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.420104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8e0c6a-b0d3-42ca-a3ce-cdb6a2b03447 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.427309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 780/1590] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/users => generated 303 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:34.427309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.428461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.429080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.429381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.429645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.430290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.431892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.437995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f02c2a-317b-427f-95ce-d056ca33ed3f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.443328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.443979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.444353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 811/1591] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.445248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.448682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.449611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.450641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.453841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.457066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66eeb76-8227-4810-839f-f5f0715b56f9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.462973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.463402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.463750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.464092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.465154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.469851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 781/1592] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.470019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.470118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.479656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da8c5-2d01-4818-9050-158dd787878f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.480773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 812/1593] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.481344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.486165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.486819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.487165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.487417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.488070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.490114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.493854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bc0327-0fff-4f8c-94bc-338ea13bc21f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.499667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.500332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.500642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.500950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] PATH_INFO: `/v3/projects/0c7ef40941f049c7a472cb39f3235241/users/7c7b660483544e33ae6e90b2e08ee753/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.507462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 782/1594] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.508534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.522216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c7ef40941f049c7a472cb39f3235241, user_id=7c7b660483544e33ae6e90b2e08ee753, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.524204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aff03-8b5f-4ca5-8bec-70b016957fb0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.525599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.530423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.531237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.531511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.531813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.532449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.534251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.540002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 813/1595] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/0c7ef40941f049c7a472cb39f3235241/users/7c7b660483544e33ae6e90b2e08ee753/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:34.540922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.557312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 783/1596] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.559076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.570674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74524d30-96e8-4676-91f1-7bd20b3be2e9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.616130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458afda-d496-46a2-9fc2-cf1ece3fbfc5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.622184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.623367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.623649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.623922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.624589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.626553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.640578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 814/1597] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.641883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.644471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.645197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.645481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.645814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] PATH_INFO: `/v3/projects/67724f6cc40e4d07832c97d5fd83f7e7/users/1cd228fd73e74924ac11dbeeac7ceeeb/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.654606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57516f19-4dab-4447-9c77-73d021fdc4c2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.660029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.660704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.661015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.661289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.662181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.662610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67724f6cc40e4d07832c97d5fd83f7e7, user_id=1cd228fd73e74924ac11dbeeac7ceeeb, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.663793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.665540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.676089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 815/1598] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:34.676935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.685832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 784/1599] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/67724f6cc40e4d07832c97d5fd83f7e7/users/1cd228fd73e74924ac11dbeeac7ceeeb/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:34.696788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.697047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ffe5b-a26a-491c-8f7e-dd1ba67bd18f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.741174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:34.766122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:34.776951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.777870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.778150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.778933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] PATH_INFO: `/v3/projects/89febcf594be4dc48a97e6199c3da9b9/users/7803d5b00079428ba28d956cec4085f8/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.779546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98439852-6de0-4a28-95bb-960b08182b64 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.784735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.785571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.785966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.786561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] PATH_INFO: `/v3/projects/96a3a5d234604ee984327b1a16a5ef87/users/e99d4fcb3eb347ef941f693c3f0531f0/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.799952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89febcf594be4dc48a97e6199c3da9b9, user_id=7803d5b00079428ba28d956cec4085f8, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.803827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e917df2-6daa-4fbb-9f6f-7164cef65062 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.806338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a3a5d234604ee984327b1a16a5ef87, user_id=e99d4fcb3eb347ef941f693c3f0531f0, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.809686 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.822586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 816/1600] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/89febcf594be4dc48a97e6199c3da9b9/users/7803d5b00079428ba28d956cec4085f8/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:34.824282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.824548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.824829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.828983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 785/1601] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/96a3a5d234604ee984327b1a16a5ef87/users/e99d4fcb3eb347ef941f693c3f0531f0/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:34.829843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.869681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] MFA Rules not processed for user `7c7b660483544e33ae6e90b2e08ee753`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:34.871067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:34.909716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17422064-ff3f-41fc-9933-c18d687edd3d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:34.914816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:34.915577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:34.915928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:34.916256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] PATH_INFO: `/v3/projects/21f3ce57892746299f029ee5c63c8217/users/53536cc9809f42a493b03687b13c9ab4/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:34.932189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f3ce57892746299f029ee5c63c8217, user_id=53536cc9809f42a493b03687b13c9ab4, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:34.935026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:34.945625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 817/1602] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:34 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:34.946938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.952676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 786/1603] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/21f3ce57892746299f029ee5c63c8217/users/53536cc9809f42a493b03687b13c9ab4/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:34.953482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:34.962074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03cc3-e3b7-4db5-9faf-0136833ba845 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.037833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.038847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.039782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a861703f-7c76-4cac-a9e1-ef680ed78d3d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.046126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.046559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.046844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.047118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] PATH_INFO: `/v3/projects/e5a4f659c0d743c692f99b38d953a197/users/7bb057384cf94a249c95fce8f7eff4e0/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.052918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.053455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.054292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.058496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c9a26-5677-414e-a031-5ec27c80914a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.064527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a4f659c0d743c692f99b38d953a197, user_id=7bb057384cf94a249c95fce8f7eff4e0, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.066927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c2c3-f197-4a02-ba9e-090ce6fb0f62 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.077826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 818/1604] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:35.079140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.079432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.079711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.090630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 787/1605] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:34 2022] PUT /identity/v3/projects/e5a4f659c0d743c692f99b38d953a197/users/7bb057384cf94a249c95fce8f7eff4e0/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:35.090630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050d38-1849-4221-8f4c-c70f575b3eed None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.090630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050d38-1849-4221-8f4c-c70f575b3eed None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.090630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb050d38-1849-4221-8f4c-c70f575b3eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.118143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-eb050d38-1849-4221-8f4c-c70f575b3eed None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.118879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] MFA Rules not processed for user `1cd228fd73e74924ac11dbeeac7ceeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.119282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eb050d38-1849-4221-8f4c-c70f575b3eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.120599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.135414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:35.188407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:35.195126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 788/1606] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.196854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.197324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.197810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.227252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 819/1607] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.228274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.230499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] MFA Rules not processed for user `e99d4fcb3eb347ef941f693c3f0531f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.231899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.257338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5701cd4-8cc4-4fde-8c98-a54d3ccacbde None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.269524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.270444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.270734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.271146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.271797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.273787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30815d-ec6b-4ca1-b166-ac1099ca2ed5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.315642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 820/1608] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/projects => generated 403 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:35.320929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09c13-f7f2-4685-bc71-b25f1e28707d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.321217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09c13-f7f2-4685-bc71-b25f1e28707d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.321660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f09c13-f7f2-4685-bc71-b25f1e28707d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.323166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 789/1609] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.324467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.338213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e0e5e-11dc-4a88-bd47-f12bad696441 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.344574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-01f09c13-f7f2-4685-bc71-b25f1e28707d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.346291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-01f09c13-f7f2-4685-bc71-b25f1e28707d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.428963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.430059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.430489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.430925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] PATH_INFO: `/v3/projects/6ac0fe264fc747dc9cfcb209d6ae059e/users/5f21cce3ea6e4544adae11644b270cea/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.433644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 821/1610] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.435555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.435555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.435765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.457315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.459205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.466841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac0fe264fc747dc9cfcb209d6ae059e, user_id=5f21cce3ea6e4544adae11644b270cea, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.470501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2dc5e9-49ff-4de0-942f-6058637b8c59 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.474741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 822/1611] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.475895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.492497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 790/1612] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:35 2022] PUT /identity/v3/projects/6ac0fe264fc747dc9cfcb209d6ae059e/users/5f21cce3ea6e4544adae11644b270cea/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:35.495451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae694c-1927-46dd-a1cd-c7833975b1b9 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.495881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae694c-1927-46dd-a1cd-c7833975b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.496252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae694c-1927-46dd-a1cd-c7833975b1b9 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.499547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 791/1613] 10.222.0.64 () {54 vars in 962 bytes} [Thu Aug 25 02:56:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:35.501344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae694c-1927-46dd-a1cd-c7833975b1b9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.548385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157c1172-ccc9-4ada-b191-f40156f5eb1c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.555694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:35.602108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae694c-1927-46dd-a1cd-c7833975b1b9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.609580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.610532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.610884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.611259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.612076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.612954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.613631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.614181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.614463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.615893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.629997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.632077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.649430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 823/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:35.650383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.651847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 792/1615] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/users => generated 308 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:35.653172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.662658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c612c158-3449-4396-88cc-f1f69afff6eb service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.667240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.668235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.668554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.668884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.670178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.671747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359fd93-7d10-4e33-906f-532b9655c7cf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.673656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155f26f-0e59-4ee4-80d7-ea9353198709 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.677403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.678018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.678302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.678573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.692707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.694174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.722545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 793/1616] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:35.724556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.724711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 824/1617] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:35.726431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47714b1-e022-4527-91c4-d93b0c0fb840 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.726836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47714b1-e022-4527-91c4-d93b0c0fb840 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.727190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47714b1-e022-4527-91c4-d93b0c0fb840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.736776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:35.748263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d889b19-2261-4cd9-b405-c53fb437ecc7 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.754774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f47714b1-e022-4527-91c4-d93b0c0fb840 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.756711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f47714b1-e022-4527-91c4-d93b0c0fb840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.840018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 825/1618] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:35.841563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.841970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.842350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.870651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.871683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.871990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.873051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.902203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.903838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.911489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:35.913706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:35.921542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 794/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:35.923194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:35.946855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72171805-7acd-498c-8f67-1bf81330bdb4 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:35.956941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:35.957946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:35.958766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:35.959316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:35.960656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:35.963441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:35.993024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 795/1620] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:35.995497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.012837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee8176-5c2f-42f4-a315-094828115e02 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.026868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.027492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.027773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.028047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.028749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.030721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.066454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 826/1621] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:36.067648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 796/1622] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:35 2022] POST /identity/v3/users => generated 300 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:36.068687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.068834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.082605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f91dfb-9942-4363-ad94-7e2b0df19744 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.083604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba5987b-8e96-4eb3-8b09-f36d8d7cae65 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.090163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.090974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.091328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.091675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] PATH_INFO: `/v3/projects/0079b2f1f1a4442fb1d412556f228174/users/38c2e457ae464f059271c70c95652911/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.095461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.096366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.096917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.097361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.110358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0079b2f1f1a4442fb1d412556f228174, user_id=38c2e457ae464f059271c70c95652911, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.111443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.114434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.118162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.134606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 827/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:36.137678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.141260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 797/1624] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:36 2022] PUT /identity/v3/projects/0079b2f1f1a4442fb1d412556f228174/users/38c2e457ae464f059271c70c95652911/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:36.143218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.174516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa50d95-042e-4779-8240-a3d2c541fff1 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.259763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8ba38-aeb7-4861-bb82-8a8a039f1850 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.274642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.275980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.276548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.277420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.278367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.281373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.283189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:36.303231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 798/1625] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:36.305882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.325165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ee9b7-ba9b-4b7e-91e1-c797561bf238 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.330978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.331615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.332306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.332709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.333283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.335078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.347971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 799/1626] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:36.348679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.361209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.361849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.362198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.362404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.370448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff40454-6ce4-47bd-99de-fafbafcaa710 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.372670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:36.385274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.385969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.386253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.386535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] PATH_INFO: `/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3/users/cc250284394c440d9b7c81eddb11b422/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.422131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a3c151d5fe4b2199b7f27604da51d3, user_id=cc250284394c440d9b7c81eddb11b422, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.431038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.454733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 800/1627] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:36 2022] PUT /identity/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3/users/cc250284394c440d9b7c81eddb11b422/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:36.455487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.485066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.487217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.501310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 828/1628] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:36.501950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.540217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf2e1e-7ebf-4928-8dc1-93f70bd3d996 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.556744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdb7a4-1171-4401-bd83-a2e3d0e64736 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.563341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.564366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.564789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.565356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] PATH_INFO: `/v3/projects/0079b2f1f1a4442fb1d412556f228174/users/38c2e457ae464f059271c70c95652911/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.567910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0079b2f1f1a4442fb1d412556f228174, user_id=38c2e457ae464f059271c70c95652911, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.570944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1481e-99db-4958-b580-33f105e735d5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.598580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 801/1629] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:36 2022] PUT /identity/v3/projects/0079b2f1f1a4442fb1d412556f228174/users/38c2e457ae464f059271c70c95652911/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:36.620079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.620947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.621336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.654093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.654770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.655117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.655397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.656053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.657785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.677393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 829/1630] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:36.679406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.683676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] MFA Rules not processed for user `38c2e457ae464f059271c70c95652911`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:36.686770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:36.696949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572a35b-2a2c-42aa-9636-2f2fdd9139c8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:36.780709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:36.781552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.781832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.782444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] PATH_INFO: `/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3/users/cc250284394c440d9b7c81eddb11b422/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.784764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a3c151d5fe4b2199b7f27604da51d3, user_id=cc250284394c440d9b7c81eddb11b422, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:36.787510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbc5b5-2d00-4047-9fb0-f7fb49c30870 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:36.809311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 830/1631] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:36 2022] PUT /identity/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3/users/cc250284394c440d9b7c81eddb11b422/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:36.812956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f24a-40d9-4d8b-90f5-ebe0109bda0c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:36.815724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f24a-40d9-4d8b-90f5-ebe0109bda0c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:36.816246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345f24a-40d9-4d8b-90f5-ebe0109bda0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:36.835190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 802/1632] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:36.842937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:36.919350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3345f24a-40d9-4d8b-90f5-ebe0109bda0c None None] MFA Rules not processed for user `cc250284394c440d9b7c81eddb11b422`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:36.922296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3345f24a-40d9-4d8b-90f5-ebe0109bda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:36.960723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:36.978289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:37.001521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf8934-f697-4807-8748-fd49cef332b6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:37.072225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 831/1633] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:56:37.081772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d886ed-3fcb-4272-bb99-445d8f12d7d5 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.082207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d886ed-3fcb-4272-bb99-445d8f12d7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.082654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d886ed-3fcb-4272-bb99-445d8f12d7d5 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.085398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 832/1634] 10.222.0.64 () {54 vars in 912 bytes} [Thu Aug 25 02:56:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:37.090919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.093155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.094524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.126958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:37.127604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.129237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.129461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.140381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:37.141966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:37.242899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:37.248692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:37.286295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 833/1635] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:56:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:37.287410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:37.287750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 803/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:36 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:37.301208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d1c25-ba84-4fad-b112-976e6376f0a4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:37.306332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:37.307058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.307398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.307681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.326891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:37.328365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:37.355255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 834/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:37.396849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:37.409022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:37.421312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4ae7-7b0f-44cd-9de5-bca07f5f905a service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:37.441586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:37.446490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.448967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.449270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.529831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:37.538426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:37.573887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc099bf-0d80-46f5-9fff-5bfbb19dafd2 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:37.585005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 835/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:37.589656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:37.590312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.590586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.590891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] PATH_INFO: `/v3/users/e99d4fcb3eb347ef941f693c3f0531f0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.599173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99d4fcb3eb347ef941f693c3f0531f0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:37.601591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:37.695084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:37.709492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431a52b-70c3-4a2d-8c9a-5027ca533aec service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:37.718749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99d4fcb3eb347ef941f693c3f0531f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.720812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99d4fcb3eb347ef941f693c3f0531f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.722737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:37.724234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:37.726184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.726439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.726763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] PATH_INFO: `/v3/users/7c7b660483544e33ae6e90b2e08ee753` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.731925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c7b660483544e33ae6e90b2e08ee753)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:37.734424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: WARNING py.warnings [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:37.734424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: warnings.warn(msg) Aug 25 02:56:37.734424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: Aug 25 02:56:37.737144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99d4fcb3eb347ef941f693c3f0531f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.737853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:37.752285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99d4fcb3eb347ef941f693c3f0531f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.771693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-50552eda-1b80-4e88-a4a3-db0b6871bf44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99d4fcb3eb347ef941f693c3f0531f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.789155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 804/1639] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:37 2022] DELETE /identity/v3/users/e99d4fcb3eb347ef941f693c3f0531f0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:37.794622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.794984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:37.795332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:37.828188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:37.829757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:37.880905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c7b660483544e33ae6e90b2e08ee753'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.897378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c7b660483544e33ae6e90b2e08ee753'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.925673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c7b660483544e33ae6e90b2e08ee753'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.927580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c7b660483544e33ae6e90b2e08ee753'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.975458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-100d2b09-82be-4825-a7d4-533e64fb222f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c7b660483544e33ae6e90b2e08ee753'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:37.979540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:37.993786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 836/1640] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:37 2022] DELETE /identity/v3/users/7c7b660483544e33ae6e90b2e08ee753 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:37.998396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:37.999653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:38.000382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:38.006452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 805/1641] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:38.025793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:38.027110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:38.045609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:38.047651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:38.165387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 837/1642] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:38.180099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cac9d-949f-47c4-8de8-8eb3328e0098 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:38.207727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:38.209637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:38.314572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:38.317098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:38.317445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:38.317731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:38.339281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:38.343597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2060b-1335-4393-a64b-b1e9383db3c7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:38.345087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5284ddd7-1b16-426f-be96-382c23c2b100 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:38.353135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:38.355058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:38.355385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:38.356056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:38.370174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 806/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:38.374592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:38.376214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44d4cd-e521-4be7-abcb-56d0f0c42163 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:38.388439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 838/1644] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:39.110615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd8c1-23b4-4d52-acc2-e18b9a842ce8 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:39.111838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd8c1-23b4-4d52-acc2-e18b9a842ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:39.112617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcd8c1-23b4-4d52-acc2-e18b9a842ce8 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:39.114728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 807/1645] 10.222.0.64 () {54 vars in 962 bytes} [Thu Aug 25 02:56:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:39.130146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be757f1-a399-4fb8-98e8-fe0dd03dff7c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:39.130659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be757f1-a399-4fb8-98e8-fe0dd03dff7c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:39.131279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be757f1-a399-4fb8-98e8-fe0dd03dff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:39.176634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3be757f1-a399-4fb8-98e8-fe0dd03dff7c None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:39.177996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3be757f1-a399-4fb8-98e8-fe0dd03dff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:39.359420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 839/1646] 10.222.0.64 () {58 vars in 1059 bytes} [Thu Aug 25 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:39.366055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:39.366440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:39.366803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:39.368580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 808/1647] 10.222.0.64 () {54 vars in 912 bytes} [Thu Aug 25 02:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:39.374486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:39.374777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:39.375060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:39.425745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:39.428553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:39.457244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 840/1648] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:56:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:39.473043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:39.475424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:39.551048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:39.627827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7061f-64bc-4a01-a179-6eed50ee0949 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:39.638071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:39.638836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:39.639215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:39.640076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:39.666466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:39.668099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:39.690603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 809/1649] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:40.039332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:40.041212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:40.080580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0250388-7f93-4789-bb24-495294b7c7c3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:40.086921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:40.087583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:40.087865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:40.088139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] PATH_INFO: `/v3/projects/0c7ef40941f049c7a472cb39f3235241` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:40.089815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c7ef40941f049c7a472cb39f3235241)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:40.092634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:40.192157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:40.259740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c7ef40941f049c7a472cb39f3235241', 'request_id': 'req-6afcc930-2ed9-46db-8134-5c5cfbb25851'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.272963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c7ef40941f049c7a472cb39f3235241', 'request_id': 'req-6afcc930-2ed9-46db-8134-5c5cfbb25851'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.293965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c7ef40941f049c7a472cb39f3235241', 'request_id': 'req-6afcc930-2ed9-46db-8134-5c5cfbb25851'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.323506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] The token cache is being invalidate because project 0c7ef40941f049c7a472cb39f3235241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:40.323805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.327200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6afcc930-2ed9-46db-8134-5c5cfbb25851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.334743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:40.335474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 841/1650] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:40 2022] DELETE /identity/v3/projects/0c7ef40941f049c7a472cb39f3235241 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:40.353109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c307-d4bd-4322-bbf1-85bade1a9ce2 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:40.502852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:40.503778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:40.504060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:40.506547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] PATH_INFO: `/v3/users/38c2e457ae464f059271c70c95652911` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:40.509753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c2e457ae464f059271c70c95652911)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:40.517300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:40.638237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:40.638848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:40.639347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:40.643834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c2e457ae464f059271c70c95652911'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.644703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c2e457ae464f059271c70c95652911'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.656281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c2e457ae464f059271c70c95652911'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.667343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c2e457ae464f059271c70c95652911'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.685412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c2e457ae464f059271c70c95652911'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:40.693350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 810/1651] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:40 2022] DELETE /identity/v3/users/38c2e457ae464f059271c70c95652911 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:40.696434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] MFA Rules not processed for user `5f21cce3ea6e4544adae11644b270cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:40.698006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:40.853173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 842/1652] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:40 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:56:40.857558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:40.859292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:40.961028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:40.988103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df7a02d-c66b-418a-9eb5-0a579b32db5a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.017695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.018631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.019627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.020044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.021550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.024038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.098236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 811/1653] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:40 2022] POST /identity/v3/projects => generated 403 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:41.099845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.116986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299ae8d-6279-4ac6-b1da-faab7273d6c3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.175778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.177749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:41.270524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.272450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.273084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.273698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.274614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.287219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.341036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 843/1654] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:41 2022] POST /identity/v3/users => generated 308 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:41.345282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.368144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2bd94-bd37-40d7-954c-b23fa03cf725 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.388122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.390571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.391263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.392879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.394019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.396189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.413490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da274f1-d59c-444e-b6cf-18a8832da183 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.438254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.439005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.439218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.439496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] PATH_INFO: `/v3/projects/96a3a5d234604ee984327b1a16a5ef87` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.441293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a3a5d234604ee984327b1a16a5ef87)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.444855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 844/1655] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:56:41.445810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: WARNING py.warnings [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:41.445810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: warnings.warn(msg) Aug 25 02:56:41.445810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: Aug 25 02:56:41.447049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.447322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.451866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:41.493521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36e5d1-06fa-425d-b669-582e277d05f6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.501424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.507160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.508199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.508522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] PATH_INFO: `/v3/users/1cd228fd73e74924ac11dbeeac7ceeeb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.510618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd228fd73e74924ac11dbeeac7ceeeb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.513507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.565068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:41.596177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a3a5d234604ee984327b1a16a5ef87', 'request_id': 'req-858948b7-04ba-4ac0-b07b-74ed25e974fd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.617201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a3a5d234604ee984327b1a16a5ef87', 'request_id': 'req-858948b7-04ba-4ac0-b07b-74ed25e974fd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.630392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a3a5d234604ee984327b1a16a5ef87', 'request_id': 'req-858948b7-04ba-4ac0-b07b-74ed25e974fd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.667592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd228fd73e74924ac11dbeeac7ceeeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.687096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd228fd73e74924ac11dbeeac7ceeeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.696351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] The token cache is being invalidate because project 96a3a5d234604ee984327b1a16a5ef87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:41.697861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.700053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.708138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 812/1656] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:41 2022] DELETE /identity/v3/projects/96a3a5d234604ee984327b1a16a5ef87 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:56:41.709420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.712786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd228fd73e74924ac11dbeeac7ceeeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.713783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:41.714284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd228fd73e74924ac11dbeeac7ceeeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.769663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd228fd73e74924ac11dbeeac7ceeeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:41.799153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 845/1657] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:41 2022] DELETE /identity/v3/users/1cd228fd73e74924ac11dbeeac7ceeeb => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:41.799153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:41.799153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:41.952659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858948b7-04ba-4ac0-b07b-74ed25e974fd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.954071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae08b4a-c08c-4491-af83-be0a340368fe admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:41.961700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.962649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.963068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.963478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] PATH_INFO: `/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca/users/f057dd826c704c499e49a162fb3eb52e/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.972016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:41.972835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:41.973187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:41.973552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] PATH_INFO: `/v3/users/cc250284394c440d9b7c81eddb11b422` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:41.974976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc250284394c440d9b7c81eddb11b422)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:41.977256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:41.977398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:41.995956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f4860775e34daf92bd0b4a7e8a99ca, user_id=f057dd826c704c499e49a162fb3eb52e, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:42.004639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3fc0a-f422-4fee-af81-e96063e8df7a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:42.036905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 813/1658] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:41 2022] PUT /identity/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca/users/f057dd826c704c499e49a162fb3eb52e/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:42.039679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.040263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.040805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.086776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc250284394c440d9b7c81eddb11b422'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.096587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:42.098274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:42.105225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc250284394c440d9b7c81eddb11b422'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.118369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc250284394c440d9b7c81eddb11b422'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.120311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc250284394c440d9b7c81eddb11b422'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.153459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc250284394c440d9b7c81eddb11b422'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.173127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 846/1659] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:41 2022] DELETE /identity/v3/users/cc250284394c440d9b7c81eddb11b422 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:42.174832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:42.178924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:42.206379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:42.265886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 814/1660] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:42.271048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:42.276089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:42.313685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0ab78-5da5-4f59-818f-13524afb22b8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:42.359664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d593e1a6-05b0-47d1-bbb8-d60be6f1f461 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:42.380675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:42.380675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.381107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.382977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.382977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:42.384340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:42.418211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 847/1661] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:42 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:42.423370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:42.444865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752eb31-0874-452e-9577-1e5b4027a28c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:42.455405 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:42.456078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.456360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.456677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] PATH_INFO: `/v3/projects/0079b2f1f1a4442fb1d412556f228174` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.460671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0079b2f1f1a4442fb1d412556f228174)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:42.462798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:42.464542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:42.465887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.468833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.471523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] PATH_INFO: `/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca/users/f057dd826c704c499e49a162fb3eb52e/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.477236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f4860775e34daf92bd0b4a7e8a99ca, user_id=f057dd826c704c499e49a162fb3eb52e, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:42.486629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc08e588-a79c-4bab-bde0-664655e59e5c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:42.542209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 848/1662] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:42 2022] PUT /identity/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca/users/f057dd826c704c499e49a162fb3eb52e/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:42.605082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0079b2f1f1a4442fb1d412556f228174', 'request_id': 'req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.626479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0079b2f1f1a4442fb1d412556f228174', 'request_id': 'req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.646421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0079b2f1f1a4442fb1d412556f228174', 'request_id': 'req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.672728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] The token cache is being invalidate because project 0079b2f1f1a4442fb1d412556f228174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:42.673152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.674620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:42.679257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 815/1663] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:42 2022] DELETE /identity/v3/projects/0079b2f1f1a4442fb1d412556f228174 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:42.684732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52b153-61c8-4543-a916-c42961f301b5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.685027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52b153-61c8-4543-a916-c42961f301b5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.685311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52b153-61c8-4543-a916-c42961f301b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.746503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5c52b153-61c8-4543-a916-c42961f301b5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:42.748223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c52b153-61c8-4543-a916-c42961f301b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:42.786424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:42.790910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:42.836979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:42.940947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 849/1664] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:42.948608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:42.951377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:42.952099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:42.989759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76f5316-03a6-4fd3-bdb1-40a1818e6b33 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.004082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.005362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.007776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.007914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.008420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:43.019194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:43.020314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:43.041532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 850/1665] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:43.045886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.052910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.054424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.071589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f3724-78a5-4989-9c53-ba41f7dd0b92 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.080245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.081208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.081584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.081953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.082791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:43.083188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.086250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.088774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 816/1666] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:43.112107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 851/1667] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:43.116426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.135944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab46ec-0fa0-4f18-a4f7-e20e2e18bbdc service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.155463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.156097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.156380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.156682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.157324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.159299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.227447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 817/1668] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:43 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:43.228632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.239287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f459-4db6-4580-bf07-219f807315fd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.334710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.336606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.341380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.342592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.343432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.345774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.402556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 852/1669] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:43 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:43.406632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.427451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f1a82-6aa1-40af-9c2b-8e5716a7f035 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.442285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.442285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.442285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.442634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.443537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.445262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.474941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 818/1670] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:43.478794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.487001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:43.497783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf71a4-1539-4248-ba7c-2963d8e9dbb4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.520430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.520886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.521315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.521669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.522413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.524047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86caf4b-97f8-433e-a4c1-1159b2f5f36f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.558159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 853/1671] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:43 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:43.561216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:43.577006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da245f-e798-4d13-bbc2-91fd8e8cee8f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:43.592055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:43.592851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.593134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.593412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] PATH_INFO: `/v3/projects/b60020c40048465db6c1caa2170cf2a0/users/6f5ec789caf54f72b0a3f7e89c3bb1b9/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.629824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60020c40048465db6c1caa2170cf2a0, user_id=6f5ec789caf54f72b0a3f7e89c3bb1b9, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:43.632788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:43.670099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 819/1672] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:43 2022] PUT /identity/v3/projects/b60020c40048465db6c1caa2170cf2a0/users/6f5ec789caf54f72b0a3f7e89c3bb1b9/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:43.676955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:43.676955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:43.678084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:43.759468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] MFA Rules not processed for user `6f5ec789caf54f72b0a3f7e89c3bb1b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:43.760914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:43.953097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 854/1673] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:43.953663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.116712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd81b2b1-4cef-4978-828b-bbff5e1d05b6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.126163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.126840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.127197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.127534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.128249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.131044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.176575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 820/1674] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:43 2022] POST /identity/v3/projects => generated 363 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:56:44.182824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.201695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12b8db-8fb6-4a89-86b9-d69bedc723ed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.361512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.362568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.363259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.364301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.388061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.390865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.438743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 855/1675] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:44 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:44.442661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.458738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57c5a9-29b7-44e4-9cb7-6de125518471 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.473885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.475174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.475700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.475800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.478854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.483218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.511646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 821/1676] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:44.516655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.530374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e5268-8586-4052-8991-10e86403e92f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.542890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.544593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.545109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.545768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] PATH_INFO: `/v3/projects/7f35d60dbb21407ba5cae86708fe5537/users/028c695cc94340f19e811e8e246b52e7/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.571430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f35d60dbb21407ba5cae86708fe5537, user_id=028c695cc94340f19e811e8e246b52e7, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.575924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.582618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.584422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:44.609186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 856/1677] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:44 2022] PUT /identity/v3/projects/7f35d60dbb21407ba5cae86708fe5537/users/028c695cc94340f19e811e8e246b52e7/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:44.610245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a09fcb-9c9b-45d3-90db-9590fa5caf44 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.611322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.711309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:44.721778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:44.790547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee242f4-4e6f-4353-9544-40270eb51f41 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.794081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.794749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.795024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.797954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] PATH_INFO: `/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.801792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a3c151d5fe4b2199b7f27604da51d3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.806791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.807513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.808675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.809757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.810149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.811517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.814086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.836422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 857/1678] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:56:44.840351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.865571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54012831-140e-4e8f-bf0c-d8d792efbf85 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:44.877797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:44.879422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.879632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.880114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] PATH_INFO: `/v3/projects/7f35d60dbb21407ba5cae86708fe5537/users/028c695cc94340f19e811e8e246b52e7/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:44.896219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f35d60dbb21407ba5cae86708fe5537, user_id=028c695cc94340f19e811e8e246b52e7, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:44.902848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:44.923680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 858/1679] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:44 2022] PUT /identity/v3/projects/7f35d60dbb21407ba5cae86708fe5537/users/028c695cc94340f19e811e8e246b52e7/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:44.926224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:44.927527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a3c151d5fe4b2199b7f27604da51d3', 'request_id': 'req-37d0b2a7-2940-46e8-ae47-d231b98f4b91'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:44.936617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:44.940104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a3c151d5fe4b2199b7f27604da51d3', 'request_id': 'req-37d0b2a7-2940-46e8-ae47-d231b98f4b91'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:44.953838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a3c151d5fe4b2199b7f27604da51d3', 'request_id': 'req-37d0b2a7-2940-46e8-ae47-d231b98f4b91'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:44.981737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] The token cache is being invalidate because project f0a3c151d5fe4b2199b7f27604da51d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:44.982439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:44.983248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-37d0b2a7-2940-46e8-ae47-d231b98f4b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:44.984939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 822/1680] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:44 2022] DELETE /identity/v3/projects/f0a3c151d5fe4b2199b7f27604da51d3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:56:44.986318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031dde-78b0-4414-b02d-cbd1aa6c9a55 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:44.986674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031dde-78b0-4414-b02d-cbd1aa6c9a55 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:44.987022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031dde-78b0-4414-b02d-cbd1aa6c9a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.056423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8d031dde-78b0-4414-b02d-cbd1aa6c9a55 None None] MFA Rules not processed for user `028c695cc94340f19e811e8e246b52e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.057637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8d031dde-78b0-4414-b02d-cbd1aa6c9a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.077808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57110334-a4ce-4513-9af8-af57051f77b2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.086126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.086957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.088260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.088746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] PATH_INFO: `/v3/projects/67724f6cc40e4d07832c97d5fd83f7e7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.095332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67724f6cc40e4d07832c97d5fd83f7e7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:45.100336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:45.183047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67724f6cc40e4d07832c97d5fd83f7e7', 'request_id': 'req-39801dc8-11c4-4fb6-b1b5-674171136be8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:45.191558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67724f6cc40e4d07832c97d5fd83f7e7', 'request_id': 'req-39801dc8-11c4-4fb6-b1b5-674171136be8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:45.194457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 823/1681] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.197572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.197781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.198133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.216863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67724f6cc40e4d07832c97d5fd83f7e7', 'request_id': 'req-39801dc8-11c4-4fb6-b1b5-674171136be8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:45.233677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] The token cache is being invalidate because project 67724f6cc40e4d07832c97d5fd83f7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:45.234003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:45.234721 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-39801dc8-11c4-4fb6-b1b5-674171136be8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:45.240771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 859/1682] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:44 2022] DELETE /identity/v3/projects/67724f6cc40e4d07832c97d5fd83f7e7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:45.240771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976f6d-fb3d-49dd-9078-21cb6cbf2e40 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.240771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976f6d-fb3d-49dd-9078-21cb6cbf2e40 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.240771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5976f6d-fb3d-49dd-9078-21cb6cbf2e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.243351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.244914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.273844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e5976f6d-fb3d-49dd-9078-21cb6cbf2e40 None None] MFA Rules not processed for user `58f1742030694f7d8203b220c485a7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.275889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5976f6d-fb3d-49dd-9078-21cb6cbf2e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.301624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:45.351379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 824/1683] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.352812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:45.359287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.383231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:45.439061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 860/1684] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.441995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ffbe-0376-4f6d-acf7-16f141aceac9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.442293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ffbe-0376-4f6d-acf7-16f141aceac9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.442572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398ffbe-0376-4f6d-acf7-16f141aceac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.497134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7398ffbe-0376-4f6d-acf7-16f141aceac9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.498305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7398ffbe-0376-4f6d-acf7-16f141aceac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.522850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 861/1685] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.525928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f668-7a66-496b-b8db-224f3e2a19cc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.526225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f668-7a66-496b-b8db-224f3e2a19cc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.526574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1976f668-7a66-496b-b8db-224f3e2a19cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.531600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0f064-0027-41d1-bf87-d5eb2093f06d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.540995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.541644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.541927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.542410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.547837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.577117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1976f668-7a66-496b-b8db-224f3e2a19cc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.578388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1976f668-7a66-496b-b8db-224f3e2a19cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.603050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 862/1686] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.604360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595204-d3cf-405c-8153-adf0f806f8fe None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.604675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595204-d3cf-405c-8153-adf0f806f8fe None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.604954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32595204-d3cf-405c-8153-adf0f806f8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.649815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-32595204-d3cf-405c-8153-adf0f806f8fe None None] MFA Rules not processed for user `58f1742030694f7d8203b220c485a7d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.651139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-32595204-d3cf-405c-8153-adf0f806f8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.674245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 863/1687] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.676717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.676994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.679079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.708105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:45.709915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:45.729691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:45.731736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.755917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 825/1688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:45.757840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:45.769578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 864/1689] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:45.772713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:45.774933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:45.793240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bca77e-2514-4a5f-9c8b-a0bf6ad74560 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.812927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.813620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.813905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.815579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.816268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:45.816605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:45.818298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:45.863281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 826/1690] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:45.863281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:45.891521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4316f71-328d-4319-ae4e-495ffaa104ec admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.904996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.905625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.905908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.907396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.909375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:45.909692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:45.913434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:45.945103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 827/1691] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:45.946079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:45.969910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1f92e9-ee61-4637-8edd-501b4e906beb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.979957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ecb72a-e00b-41c2-818a-b71eca624d2f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:45.981930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.982823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.984539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:45.984833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:45.985768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:45.993298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:45.998997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:45.999637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:45.999918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.000192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.019214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.020914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.038823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 865/1692] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:46.039987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.052112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 828/1693] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:45 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:46.056242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.072104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c19fda-973d-453d-a35a-362ded998de6 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.179636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:46.228124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3097249f-c120-491c-940e-38ad06d710f8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.235941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.242189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.242189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.242189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.242189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.258142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.262049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.263208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.263484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.263752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.264569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.267081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.329456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 829/1694] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:46 2022] POST /identity/v3/users => generated 290 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:56:46.333285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 866/1695] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:46 2022] POST /identity/v3/projects => generated 381 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:46.333422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.334624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.390891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e55480-acd1-465b-b876-d39ac6e7879f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.522536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:46.659801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfd504-43fc-4063-8e0f-94117292958c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.676620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.680694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.680910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.681189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.685059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.685898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.686113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.688221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.692728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.693158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.693889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.695564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.739541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 830/1696] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:56:46.742655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.781224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809eaced-40fd-4c16-a43b-9cf06d9f6a54 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.781414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 867/1697] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:46 2022] POST /identity/v3/users => generated 291 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:46.785197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.790861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.791674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.792010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.792291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.796137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.797882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.823218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83639549-610f-41bb-93e0-e4b1cb12cafc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.829062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 831/1698] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:56:46.830267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.854390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36d54c-dbcd-4e1f-89d1-ac22e392a4ee admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:46.857708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.858523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.858960 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.859380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.863858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.868386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:46.869018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.869133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.869401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.869801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] PATH_INFO: `/v3/projects/a018162f1fa44791a0003c36ee41c780/users/713c6a8687bf47a6aa57b9d624ac9a97/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.903362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a018162f1fa44791a0003c36ee41c780, user_id=713c6a8687bf47a6aa57b9d624ac9a97, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:46.908475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd9827-bfad-4e49-8230-415bd1e6f9e0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:46.913464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 868/1699] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:46.919857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:46.936639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 832/1700] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:46 2022] PUT /identity/v3/projects/a018162f1fa44791a0003c36ee41c780/users/713c6a8687bf47a6aa57b9d624ac9a97/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:46.947952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcad562-d969-44a3-bb4b-7c5ed724c980 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:46.948242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcad562-d969-44a3-bb4b-7c5ed724c980 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:46.948535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcad562-d969-44a3-bb4b-7c5ed724c980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:46.963850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac9039-e452-4166-9909-bc878dbf7944 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.009796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-6bcad562-d969-44a3-bb4b-7c5ed724c980 None None] MFA Rules not processed for user `713c6a8687bf47a6aa57b9d624ac9a97`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.011048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6bcad562-d969-44a3-bb4b-7c5ed724c980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.100933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.101560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.101842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.102120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.102766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.105224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:47.122665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 869/1701] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:47.123992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:47.126000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.141899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39259a4b-e9b3-44cb-ba11-d509288dbc2a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.148820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.149754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.149935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.150328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] PATH_INFO: `/v3/users/6f5ec789caf54f72b0a3f7e89c3bb1b9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.151515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5ec789caf54f72b0a3f7e89c3bb1b9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.155783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:47.177510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 833/1702] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:47.180015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037da1-cf25-4842-88ff-24a27466c5fc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.180783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037da1-cf25-4842-88ff-24a27466c5fc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.180956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7037da1-cf25-4842-88ff-24a27466c5fc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.182532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 834/1703] 10.222.0.64 () {54 vars in 912 bytes} [Thu Aug 25 02:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:47.184311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037da1-cf25-4842-88ff-24a27466c5fc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:47.218296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7037da1-cf25-4842-88ff-24a27466c5fc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.225504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.228144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.228455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.229978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] PATH_INFO: `/v3/projects/7bc86bec44d94a76951bcf5623bb9d30/users/0e1fae2124ea4da9a485d668d1cf2b0f/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.254071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5ec789caf54f72b0a3f7e89c3bb1b9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:47.285900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5ec789caf54f72b0a3f7e89c3bb1b9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:47.288645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc86bec44d94a76951bcf5623bb9d30, user_id=0e1fae2124ea4da9a485d668d1cf2b0f, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.296779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:47.302454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5ec789caf54f72b0a3f7e89c3bb1b9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:47.304210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5ec789caf54f72b0a3f7e89c3bb1b9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:47.337413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 835/1704] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:47 2022] PUT /identity/v3/projects/7bc86bec44d94a76951bcf5623bb9d30/users/0e1fae2124ea4da9a485d668d1cf2b0f/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:47.340098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:47.350334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3bbb416f-f56c-43ca-9723-670de68b95df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5ec789caf54f72b0a3f7e89c3bb1b9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:47.364652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:47.371386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 870/1705] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:47 2022] DELETE /identity/v3/users/6f5ec789caf54f72b0a3f7e89c3bb1b9 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:47.372217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f054f6-8cc4-4a1b-86a7-adb4bb36383b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.372610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f054f6-8cc4-4a1b-86a7-adb4bb36383b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.372893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f054f6-8cc4-4a1b-86a7-adb4bb36383b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.469545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:47.476712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-21f054f6-8cc4-4a1b-86a7-adb4bb36383b None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.480672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-21f054f6-8cc4-4a1b-86a7-adb4bb36383b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.503533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef3d9eb-76d3-4d07-8189-315ddf45ead5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.576857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 871/1706] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:47.578286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98474aa-7172-44d6-a3eb-14dcd7612df7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.578571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98474aa-7172-44d6-a3eb-14dcd7612df7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.578843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98474aa-7172-44d6-a3eb-14dcd7612df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.611248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a98474aa-7172-44d6-a3eb-14dcd7612df7 None None] MFA Rules not processed for user `0e1fae2124ea4da9a485d668d1cf2b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.612505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a98474aa-7172-44d6-a3eb-14dcd7612df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.717437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.718351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.718681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.718957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.719747 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.725450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:47.779470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 872/1707] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:47.781005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572b65-8504-42f6-8d69-8942d30420c7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.781289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572b65-8504-42f6-8d69-8942d30420c7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.781560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07572b65-8504-42f6-8d69-8942d30420c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.797543 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 836/1708] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/projects => generated 379 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:47.798498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:47.802158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.818526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-07572b65-8504-42f6-8d69-8942d30420c7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.819829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-07572b65-8504-42f6-8d69-8942d30420c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.904665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 873/1709] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:47.906169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.906466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.906799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.912286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680dc79-c177-4b91-b62c-67990b50836f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.917493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.919172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.919600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.920004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.932702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.935904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:47.953489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 837/1710] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:47.954220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] MFA Rules not processed for user `f057dd826c704c499e49a162fb3eb52e`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.954705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:47.957325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.957932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.977407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37baca-51e5-417d-a43e-9d780bff5f7f service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:47.984106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:47.984974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.985495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.985901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.986669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:47.988868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.032897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.050205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 838/1711] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:48.051784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.055385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.122606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 874/1712] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:48.123621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.135400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.151626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdf28-affa-4689-acc0-205d98d59f82 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.250824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e0d53-f131-4350-85cf-4fa116bf3038 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.265117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.265758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.266567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.266567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.266965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.271664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.300684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.301924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.302212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.303227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.324891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 839/1713] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:48 2022] POST /identity/v3/users => generated 296 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:48.325832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.332838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.336901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.351091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fccedf-69d9-4c84-a40f-3d978ac06ccb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.359901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 875/1714] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:48.362122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.366400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.368097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.368459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.369165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.369493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.375866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.410559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f926605-1ff2-493c-8248-f9defd42f285 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.422429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.422964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.423339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.423707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.424481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.426670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.441872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 840/1715] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:48 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:48.443466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.460029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 876/1716] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:48.465603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.470001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832b05b-e1fc-438f-8008-9ef53acf75fc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.487916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.490380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.492112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.492758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.496312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.500878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a51f104-9fee-4579-a65f-350e0add3596 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.501932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.520255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.521056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.521343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.521623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] PATH_INFO: `/v3/projects/d501c8b8af974d5c96e253d61701fd43/users/22d71ce31a724ee89e7514621a167c7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.549503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 841/1717] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:48.553754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.579709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d501c8b8af974d5c96e253d61701fd43, user_id=22d71ce31a724ee89e7514621a167c7f, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.581278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb6a0-07e5-451b-87fb-1c965fc0f62a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.593293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.606327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.609316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.610174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.611402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] PATH_INFO: `/v3/projects/1c2524f263464a39af0b2d45a7c3d69c/users/1209d64f070f43c98a118d9cffba9a4c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.639709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 877/1718] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:48 2022] PUT /identity/v3/projects/d501c8b8af974d5c96e253d61701fd43/users/22d71ce31a724ee89e7514621a167c7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:48.652091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.680619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2524f263464a39af0b2d45a7c3d69c, user_id=1209d64f070f43c98a118d9cffba9a4c, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.692204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.735885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 842/1719] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:48 2022] PUT /identity/v3/projects/1c2524f263464a39af0b2d45a7c3d69c/users/1209d64f070f43c98a118d9cffba9a4c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:48.743937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.812280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3406b2-2e89-481f-ba10-7ccd51843e8f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.930586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.960089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.960810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.961090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.961362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.962016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.964608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.006781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4bed7-3a75-430b-887b-4afc03d61c51 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.037164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 878/1720] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:49.037945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.038126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.038522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.038809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.044014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.051929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.054132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c0be6-8d39-4662-885d-b326362483e7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.070831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6d07b-b2a4-4b08-9965-2b2e722b9217 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.083078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.083775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.084055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.084337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] PATH_INFO: `/v3/projects/d501c8b8af974d5c96e253d61701fd43/users/22d71ce31a724ee89e7514621a167c7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.097438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d501c8b8af974d5c96e253d61701fd43, user_id=22d71ce31a724ee89e7514621a167c7f, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.102464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2206662-6e7a-4d14-9301-02ba0ca26647 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.103042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 843/1721] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:49.104679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c1a7-20dd-4d23-83d9-289534ffdcf8 None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.105170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c1a7-20dd-4d23-83d9-289534ffdcf8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.105693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9730c1a7-20dd-4d23-83d9-289534ffdcf8 None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.108937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 844/1722] 10.222.0.64 () {54 vars in 961 bytes} [Thu Aug 25 02:56:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:49.109900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c1a7-20dd-4d23-83d9-289534ffdcf8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.124097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 879/1723] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:49 2022] PUT /identity/v3/projects/d501c8b8af974d5c96e253d61701fd43/users/22d71ce31a724ee89e7514621a167c7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:49.134474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148cdb2-3eff-485f-b6d3-e079064f46c8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.134791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148cdb2-3eff-485f-b6d3-e079064f46c8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.135037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148cdb2-3eff-485f-b6d3-e079064f46c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.176504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0148cdb2-3eff-485f-b6d3-e079064f46c8 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:49.181599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0148cdb2-3eff-485f-b6d3-e079064f46c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.255037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.270563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9730c1a7-20dd-4d23-83d9-289534ffdcf8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.277049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.277991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.278417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.278833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] PATH_INFO: `/v3/projects/1c2524f263464a39af0b2d45a7c3d69c/users/1209d64f070f43c98a118d9cffba9a4c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.281637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c2524f263464a39af0b2d45a7c3d69c, user_id=1209d64f070f43c98a118d9cffba9a4c, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.285817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9cb79-6aa5-43a4-be00-06bac226120e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.301459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 845/1724] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:49 2022] PUT /identity/v3/projects/1c2524f263464a39af0b2d45a7c3d69c/users/1209d64f070f43c98a118d9cffba9a4c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:49.304043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.305077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.305685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.352050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 880/1725] 10.222.0.64 () {58 vars in 1058 bytes} [Thu Aug 25 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:49.353415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.353592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] MFA Rules not processed for user `22d71ce31a724ee89e7514621a167c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:49.353688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.353975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.355265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.398738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] MFA Rules not processed for user `1209d64f070f43c98a118d9cffba9a4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:49.400173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.537190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 846/1726] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:49.537975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.558162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 881/1727] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:49.561904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.563800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.666752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6860105-8993-4b5b-a493-7b696f442333 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.673002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.674200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.674522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.674843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.677831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.686817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.716713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d581484-0085-4347-a0b1-94156d103dbb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.729254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.730027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.730417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.731335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.737133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.759032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.760917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.763557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.766181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.778065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 882/1728] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:49.779018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.780684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.841089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 847/1729] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:49.842150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.848383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.888289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0aad-11be-4a40-8567-27c1270fe035 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.909009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3daaef-fb96-4fd3-9820-71c2dd5e9c30 service placement] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.910066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.911853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.912002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.912345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] PATH_INFO: `/v3/projects/b60020c40048465db6c1caa2170cf2a0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.915561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60020c40048465db6c1caa2170cf2a0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.917843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.929457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.930096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.930370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.930647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.981883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.983609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.995494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60020c40048465db6c1caa2170cf2a0', 'request_id': 'req-a44320ef-61cf-4d9e-b65b-0724cbf28e06'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.002614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60020c40048465db6c1caa2170cf2a0', 'request_id': 'req-a44320ef-61cf-4d9e-b65b-0724cbf28e06'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.015826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60020c40048465db6c1caa2170cf2a0', 'request_id': 'req-a44320ef-61cf-4d9e-b65b-0724cbf28e06'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.040257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 848/1730] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:50.048866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] The token cache is being invalidate because project b60020c40048465db6c1caa2170cf2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:50.049267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.050343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.055171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 883/1731] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:49 2022] DELETE /identity/v3/projects/b60020c40048465db6c1caa2170cf2a0 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:50.059573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:50.082863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bc652-8178-40da-8f81-991a61677316 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:50.187332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:50.189278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.306630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:50.310895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:50.347596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:50.349065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:50.349598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:50.350299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] PATH_INFO: `/v3/users/028c695cc94340f19e811e8e246b52e7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:50.352186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028c695cc94340f19e811e8e246b52e7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:50.357351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44320ef-61cf-4d9e-b65b-0724cbf28e06 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:50.361625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:50.370006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:50.370647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:50.370933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:50.371247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:50.373524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.497178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028c695cc94340f19e811e8e246b52e7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.502115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028c695cc94340f19e811e8e246b52e7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.508590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:50.511179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be583dc-f711-4d9c-a3ae-60e21142d502 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:50.513795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028c695cc94340f19e811e8e246b52e7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.525084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028c695cc94340f19e811e8e246b52e7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.537434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 884/1732] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:50.567895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-702f770e-0dba-463a-81ba-9979d2e0be69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028c695cc94340f19e811e8e246b52e7'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.588892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 849/1733] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:50 2022] DELETE /identity/v3/users/028c695cc94340f19e811e8e246b52e7 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:51.218355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:51.218936 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:51.218936 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:51.282389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] MFA Rules not processed for user `7803d5b00079428ba28d956cec4085f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:51.283936 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:51.396911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 885/1734] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:51.398487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:51.398983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:51.399056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:51.438138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] MFA Rules not processed for user `7803d5b00079428ba28d956cec4085f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:51.439445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:51.465105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 850/1735] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:51.475623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:51.477547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:51.577473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1666a3d0-c072-46da-8c8e-4bc12a4acf18 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:51.583778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:51.584626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:51.585015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:51.585953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:51.596523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:51.598221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b5070-7ec6-4100-8bd5-06653dc41f83 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:51.609461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 886/1736] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:52.143468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:52.144957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:52.355260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a46da5-3327-482b-a5a2-bb1f5643f8d7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:52.366167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:52.366804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:52.367080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:52.367348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:52.375127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:52.541545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4a8e-111c-4023-b8c5-86c3aca0d688 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:52.542107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4a8e-111c-4023-b8c5-86c3aca0d688 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:52.542107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed4a8e-111c-4023-b8c5-86c3aca0d688 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:52.544228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 887/1737] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:52.571926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:52.573428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b284f9-0342-49b2-bac0-811392610f3e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:52.601782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 851/1738] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:52.688808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:52.689098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:52.689381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:52.692770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:52.693082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:52.693358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:52.715279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:52.757527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:52.758781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:52.767443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:52.774491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] MFA Rules not processed for user `53536cc9809f42a493b03687b13c9ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:52.775141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.004338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 888/1739] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:56:53.072639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 852/1740] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:53.089182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:53.091838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.125218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:53.127107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.145361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4529a-e1ce-4899-a278-926754622746 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:53.165770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:53.169344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.171298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.172998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.174072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4b5e2c-64ac-4554-b3b4-4bd66334c47d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:53.190570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:53.191210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.193348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.197189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.206349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:53.211514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec6af2c-3316-4a52-b08e-e8201e663588 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:53.233718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:53.241369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94742985-d0b7-4c17-b26f-c635cb0a8333 service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:53.269293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 889/1741] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:53.300346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 853/1742] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:56:53.570599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dd52-37ab-409c-8ec5-b3977c21d898 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.571170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dd52-37ab-409c-8ec5-b3977c21d898 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.571411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7dd52-37ab-409c-8ec5-b3977c21d898 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.573016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 890/1743] 10.222.0.64 () {54 vars in 912 bytes} [Thu Aug 25 02:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:53.583562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.584483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.584897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.616190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:53.618162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.710243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 854/1744] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:53.727397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f3c-6c27-4a99-9598-0bfde7ecffbf None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.727687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f3c-6c27-4a99-9598-0bfde7ecffbf None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.727964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438a0f3c-6c27-4a99-9598-0bfde7ecffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.748064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:53.750310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.772804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d74b3-4e4e-47c7-a907-016f1773cebf None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:53.784825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:53.785800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:53.786094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:53.786355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:53.807323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:53.809409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:53.827320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-438a0f3c-6c27-4a99-9598-0bfde7ecffbf None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:53.830626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-438a0f3c-6c27-4a99-9598-0bfde7ecffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.837120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 855/1745] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:56:53.839405 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:53.848322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:53.989241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 891/1746] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:56:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:56:54.000570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cb4f9-8c99-42b9-9657-d48bd145ac34 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:54.018977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:54.019987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.020562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.021035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] PATH_INFO: `/v3/projects/7f35d60dbb21407ba5cae86708fe5537` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.023345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f35d60dbb21407ba5cae86708fe5537)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:54.026074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:54.081570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:54.106386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f35d60dbb21407ba5cae86708fe5537', 'request_id': 'req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:54.120341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f35d60dbb21407ba5cae86708fe5537', 'request_id': 'req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:54.148106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f35d60dbb21407ba5cae86708fe5537', 'request_id': 'req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:54.192486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] The token cache is being invalidate because project 7f35d60dbb21407ba5cae86708fe5537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:54.193382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:54.194294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:54.196770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 856/1747] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:53 2022] DELETE /identity/v3/projects/7f35d60dbb21407ba5cae86708fe5537 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:54.202773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952862a3-d6ae-43bf-97bb-1d37a0555942 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.203168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952862a3-d6ae-43bf-97bb-1d37a0555942 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.203671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952862a3-d6ae-43bf-97bb-1d37a0555942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.251068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-952862a3-d6ae-43bf-97bb-1d37a0555942 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:54.257124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-952862a3-d6ae-43bf-97bb-1d37a0555942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:54.341002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:54.342480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:54.444848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:54.468852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 892/1748] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:54.473714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.474006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.474375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.506483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:54.510417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:54.528383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 893/1749] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:54.542414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:54.586598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a27797-bdd9-48f4-a36b-3a62253af790 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:54.604831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bbc0-52f2-4e13-9bd1-abb313c2a40f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:54.617509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:54.618422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:54.619048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.619152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.619348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.619624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.620747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.621306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.625476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:54.626120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:54.631907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:54.635651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:54.738034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 894/1750] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:54.741183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:54.784771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df09b135-e822-48de-8e73-cbc84a2d0b46 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:54.811431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:54.812332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:54.812746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:54.813159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:54.814709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:54.817544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8ae37-4e94-46ed-a456-660b696f6b25 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:54.884923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:54.889911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:54.925315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 857/1751] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 02:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:56:54.937305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:54.938617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 895/1752] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:54 2022] POST /identity/v3/projects => generated 377 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:54.976641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4d10f-64fd-4566-83fe-1c101d4524c8 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:55.136513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:55.302173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:55.303043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.303161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.303384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:55.304020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:55.320503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:55.425727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cb2-c415-498f-9441-d553af1b6807 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.426438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cb2-c415-498f-9441-d553af1b6807 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.426722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e4cb2-c415-498f-9441-d553af1b6807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:55.456276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 858/1753] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:54 2022] POST /identity/v3/users => generated 289 bytes in 519 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:56:55.463781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:55.503064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e535f-0819-46d6-85c8-c9e262330660 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:55.513181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-257e4cb2-c415-498f-9441-d553af1b6807 None None] MFA Rules not processed for user `7803d5b00079428ba28d956cec4085f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:55.518874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-257e4cb2-c415-498f-9441-d553af1b6807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:55.527268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:55.528129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.528495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.528938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:55.529612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:55.531545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:55.575447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 859/1754] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:55.578148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:55.622630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f6e88-42f7-41a0-84a8-852aab26a3d4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:55.642488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:55.642932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.643215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.644819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:55.647110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:55.650884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:55.693390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 860/1755] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:55 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:55.697889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:55.741901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be8128-210d-4598-862b-e3860118dd05 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:55.757612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 896/1756] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:55.760258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:55.763218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.765064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.765064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] PATH_INFO: `/v3/projects/1ed7c75fbf82429bbb278d75d23ec072/users/c5b1a4ef16184214b7a07fca0297a391/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:55.822216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ed7c75fbf82429bbb278d75d23ec072, user_id=c5b1a4ef16184214b7a07fca0297a391, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:55.834268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:55.877556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 861/1757] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:55 2022] PUT /identity/v3/projects/1ed7c75fbf82429bbb278d75d23ec072/users/c5b1a4ef16184214b7a07fca0297a391/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:55.890150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:55.890502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:55.891146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:56.032323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] MFA Rules not processed for user `c5b1a4ef16184214b7a07fca0297a391`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:56.036353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:56.450985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 897/1758] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 562 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:56.454126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:56.715417 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3baa5cb-5f1b-49c3-9df5-9a6119aa2d4c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:56.730945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:56.732163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:56.732716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:56.733229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:56.734233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:56.736376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:56.794139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 862/1759] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:56 2022] POST /identity/v3/projects => generated 377 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:56.798425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:56.816140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c4dbe3-7834-4306-b4bd-4909ac144694 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:56.940178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:56.966144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:56.967121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:56.967702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:56.968132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:56.969508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:56.975357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:57.040033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 898/1760] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:56 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:57.041459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:57.070617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b8816-2272-4b49-bc25-9e20d00f8fc8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:57.077008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:57.079427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:57.079950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:57.080593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:57.081675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:57.083566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:57.117158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 863/1761] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:57.123509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:57.161235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6220ba-5f2d-496b-9dec-1e4a0b54e964 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:57.187450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:57.189323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:57.199304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:57.199833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] PATH_INFO: `/v3/projects/8bad8f84120346b585bfb874c53d255d/users/cc0bbfe6f0d6410ab3440994654bad90/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:57.269340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bad8f84120346b585bfb874c53d255d, user_id=cc0bbfe6f0d6410ab3440994654bad90, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:57.275281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:57.278136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:57.283662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:57.315143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32b3251-4f88-46f3-9d5e-89b9935985eb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:57.332718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:57.335135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:57.335425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:57.335712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] PATH_INFO: `/v3/users/5f21cce3ea6e4544adae11644b270cea` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:57.338980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f21cce3ea6e4544adae11644b270cea)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:57.344886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:57.358841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 899/1762] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:57 2022] PUT /identity/v3/projects/8bad8f84120346b585bfb874c53d255d/users/cc0bbfe6f0d6410ab3440994654bad90/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:57.363124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:57.496925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f21cce3ea6e4544adae11644b270cea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:57.501120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f21cce3ea6e4544adae11644b270cea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:57.506130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:57.521632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f21cce3ea6e4544adae11644b270cea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:57.533456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f21cce3ea6e4544adae11644b270cea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:57.568090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f21cce3ea6e4544adae11644b270cea'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:57.595802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 864/1763] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:57 2022] DELETE /identity/v3/users/5f21cce3ea6e4544adae11644b270cea => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:56:57.664373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ddf91-2575-469f-b6d6-2366276fde38 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:57.979882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:57.981474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:57.983222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:57.984445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:57.986997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:57.991403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c02fdd8-7d30-46a4-8f6a-a664fa9945a6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:58.045995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 900/1764] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 683 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:56:58.050848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:58.052707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:58.109745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732603e-1283-4aaa-8c59-43ab00c9de85 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:58.142383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:58.143284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:58.143574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:58.143856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] PATH_INFO: `/v3/projects/8bad8f84120346b585bfb874c53d255d/users/cc0bbfe6f0d6410ab3440994654bad90/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:58.151140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bad8f84120346b585bfb874c53d255d, user_id=cc0bbfe6f0d6410ab3440994654bad90, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:58.157657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d862b44a-e662-4b67-8834-12f954f93916 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:58.223564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:58.224557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:58.225393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:58.225572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 865/1765] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:58 2022] PUT /identity/v3/projects/8bad8f84120346b585bfb874c53d255d/users/cc0bbfe6f0d6410ab3440994654bad90/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:58.375672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] MFA Rules not processed for user `cc0bbfe6f0d6410ab3440994654bad90`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:58.376975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:58.617459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:58.617748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:58.618028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:58.671698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:58.695529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:58.698470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:58.788163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 901/1766] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 566 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:58.798469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:58.803301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:58.984113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 866/1767] 10.222.0.47 () {58 vars in 1015 bytes} [Thu Aug 25 02:56:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:59.078913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082cd2-4045-499d-953b-b6ce8f17a185 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:59.090126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:59.090924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:59.091328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:59.091711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:59.099142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:59.205544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:59.207957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:59.223534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b561996-b52e-4d6f-aec5-9cf436f79cde None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:59.236100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:59.237757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:59.242911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:59.256715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:59.295854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:59.297721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:59.352969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 867/1768] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:56:59.356128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:59.358276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:59.360722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:59.362408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:59.405719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 902/1769] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:59.570844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fe931-7a51-41c6-a368-a90e097ceaf4 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:59.575898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:59.576629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:59.576914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:59.577230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] PATH_INFO: `/v3/users/713c6a8687bf47a6aa57b9d624ac9a97` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:59.580489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] RBAC: Authorizing `identity:delete_user(user_id=713c6a8687bf47a6aa57b9d624ac9a97)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:59.582615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:59.620614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:59.622432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:59.664971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8290d5-cbdb-47d6-927e-4dc550f23d75 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:59.699630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:59.700516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:59.703016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:59.703339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] PATH_INFO: `/v3/projects/6ac0fe264fc747dc9cfcb209d6ae059e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:59.704074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713c6a8687bf47a6aa57b9d624ac9a97'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.705031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac0fe264fc747dc9cfcb209d6ae059e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:59.705500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713c6a8687bf47a6aa57b9d624ac9a97'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.709277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:59.712032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:59.725776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713c6a8687bf47a6aa57b9d624ac9a97'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.771426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713c6a8687bf47a6aa57b9d624ac9a97'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.855867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-55b6b067-f9a1-4707-bdad-94088e5e670c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713c6a8687bf47a6aa57b9d624ac9a97'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.893900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 868/1770] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:59 2022] DELETE /identity/v3/users/713c6a8687bf47a6aa57b9d624ac9a97 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:59.901084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:59.902696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:59.903547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:59.904966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac0fe264fc747dc9cfcb209d6ae059e', 'request_id': 'req-5e79aaf1-c450-4149-84aa-3c825588a6d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.934013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac0fe264fc747dc9cfcb209d6ae059e', 'request_id': 'req-5e79aaf1-c450-4149-84aa-3c825588a6d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:59.960768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac0fe264fc747dc9cfcb209d6ae059e', 'request_id': 'req-5e79aaf1-c450-4149-84aa-3c825588a6d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.005196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] The token cache is being invalidate because project 6ac0fe264fc747dc9cfcb209d6ae059e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:00.006827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.009321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.009483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:00.015114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:00.022023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 903/1771] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:59 2022] DELETE /identity/v3/projects/6ac0fe264fc747dc9cfcb209d6ae059e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:00.024477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:00.033142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:00.199535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:00.388897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e79aaf1-c450-4149-84aa-3c825588a6d2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:00.413082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:00.413621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 869/1772] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:56:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:00.415774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:00.418164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:00.418584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] PATH_INFO: `/v3/users/f057dd826c704c499e49a162fb3eb52e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:00.423215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f057dd826c704c499e49a162fb3eb52e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:00.439489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:00.642616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f057dd826c704c499e49a162fb3eb52e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.675021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f057dd826c704c499e49a162fb3eb52e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.712477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f057dd826c704c499e49a162fb3eb52e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.714123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f057dd826c704c499e49a162fb3eb52e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.779339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f057dd826c704c499e49a162fb3eb52e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:00.800039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 904/1773] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:00 2022] DELETE /identity/v3/users/f057dd826c704c499e49a162fb3eb52e => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:00.845658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:00.848968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:01.038257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff8ae-abd4-4e08-9100-a879fbd5b2f1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:01.175096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:01.175935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:01.176322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:01.176725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:01.181367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:01.304228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:01.357939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:01.359948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:01.385562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 870/1774] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:02.241909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:02.249051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:02.309620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea587f-a0b7-4558-8c42-736cc2d14aab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:02.337603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:02.338531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:02.344310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:02.344429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] PATH_INFO: `/v3/users/0e1fae2124ea4da9a485d668d1cf2b0f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:02.348445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1fae2124ea4da9a485d668d1cf2b0f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:02.350435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:02.355931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:02.358665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:02.387462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cec8919-2238-4100-85c5-ebdcd8fc6fd4 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:02.394145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:02.395075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:02.395591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:02.396083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] PATH_INFO: `/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:02.397882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f4860775e34daf92bd0b4a7e8a99ca)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:02.406377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:02.519485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f4860775e34daf92bd0b4a7e8a99ca', 'request_id': 'req-44434cf3-3ac6-4f30-9d71-74ec02f9decb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.533921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f4860775e34daf92bd0b4a7e8a99ca', 'request_id': 'req-44434cf3-3ac6-4f30-9d71-74ec02f9decb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.549606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f4860775e34daf92bd0b4a7e8a99ca', 'request_id': 'req-44434cf3-3ac6-4f30-9d71-74ec02f9decb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.573329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1fae2124ea4da9a485d668d1cf2b0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.603198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1fae2124ea4da9a485d668d1cf2b0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.620792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] The token cache is being invalidate because project 21f4860775e34daf92bd0b4a7e8a99ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:02.621721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.623639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-44434cf3-3ac6-4f30-9d71-74ec02f9decb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.632545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 871/1775] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:02 2022] DELETE /identity/v3/projects/21f4860775e34daf92bd0b4a7e8a99ca => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:02.634420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1fae2124ea4da9a485d668d1cf2b0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.636160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1fae2124ea4da9a485d668d1cf2b0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.638851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942846-fedc-43e4-a7b1-945cfb543616 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:02.640011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942846-fedc-43e4-a7b1-945cfb543616 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:02.640571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67942846-fedc-43e4-a7b1-945cfb543616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:02.670052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-67942846-fedc-43e4-a7b1-945cfb543616 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:02.671671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-67942846-fedc-43e4-a7b1-945cfb543616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:02.683829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-20aeb714-348a-49b5-ba87-fc745bf4870f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1fae2124ea4da9a485d668d1cf2b0f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:02.711578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 905/1776] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:02 2022] DELETE /identity/v3/users/0e1fae2124ea4da9a485d668d1cf2b0f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:02.717259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:02.717830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:02.718382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:02.789591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:02.791361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:02.808745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:02.812429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 872/1777] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:02.822493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:02.826688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:02.826688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:02.862982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:02.864413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:02.987196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:03.009148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 873/1778] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:03.010645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:03.025443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 906/1779] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:03.034884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4bf7f-e00d-4a29-9632-49401b02c559 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:03.051514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:03.052277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.052689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.053064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.053828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:03.054241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:03.055984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:03.090936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 874/1780] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:57:03.095556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:03.107601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b3c41f-7163-4d3b-9ccb-5723d8c92c6e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:03.114860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:03.118240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:03.131015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:03.139505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.139792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.140070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.140759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:03.150071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:03.235743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 907/1781] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:03 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:03.236774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:03.244197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:03.273446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40763bb-de94-4050-91fe-cee028a77bf8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:03.364785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242e8f9-b7ab-4393-9087-ef0fa0b40d85 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:03.368753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:03.370452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.370773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.371991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.374874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:03.437899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:03.438578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.438814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.439088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.529093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:03.533737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:03.569655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 908/1782] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:03.599390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:03.600925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3357342-5c4a-4d02-97d9-534a8913ee33 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:03.602345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:03.618365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 875/1783] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:03.627084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.627363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.627633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.668436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8905a10-7970-418e-9d78-9be112487dcc service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:03.687837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:03.689209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.689760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.691749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.692764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:03.700954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96bdfe-338d-4ecf-ab5e-f3df795c95a9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:03.751300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] MFA Rules not processed for user `7bb057384cf94a249c95fce8f7eff4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:03.752612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:03.818945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 909/1784] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:03 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:03.820577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:03.900028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:03.902970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:03.906250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:03.998471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 876/1785] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:04.000590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:04.038332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adfd81-08b6-4de9-bec5-c9a61ce51c09 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:04.054392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:04.054924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:04.055200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:04.055483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:04.056199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:04.058701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:04.085315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] MFA Rules not processed for user `53536cc9809f42a493b03687b13c9ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:04.086562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:04.101134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 877/1786] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:03 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:04.107140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:04.134977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:04.160901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:04.345576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 910/1787] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 526 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:04.346307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:04.359206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57ff54-af6e-4e24-857f-4d7c1c9586c4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:04.376067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:04.381020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:04.381367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:04.382481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:04.383252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:04.393419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:04.440044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 911/1788] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:04.441883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:04.455742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9518119-0f07-4ee3-9935-493993bc38b2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:04.475739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:04.476820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:04.478718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:04.480305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] PATH_INFO: `/v3/projects/90e6699a75c54e389669385dc3f1935e/users/ec1aba995c32483095400d8205861d9b/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:04.532294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90e6699a75c54e389669385dc3f1935e, user_id=ec1aba995c32483095400d8205861d9b, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:04.542588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd256ad-660c-4229-95d5-5bac22ebec0d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:04.560658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673bd1ea-4739-4485-84d2-6d4d6cb792e1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:04.563228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:04.566943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:04.567446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:04.567808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:04.598436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:04.605665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:04.617624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 912/1789] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:04 2022] PUT /identity/v3/projects/90e6699a75c54e389669385dc3f1935e/users/ec1aba995c32483095400d8205861d9b/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:04.620079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:04.620589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:04.621182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:04.668878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 878/1790] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:04.745450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] MFA Rules not processed for user `ec1aba995c32483095400d8205861d9b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:04.748418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:05.025104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:05.026074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 913/1791] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:05.052178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccde2cd-cae0-4436-adf8-bef821bfe309 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:05.213415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:05.215596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:05.296494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:05.298746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:05.300486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:05.304005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:05.305821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:05.308819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:05.408866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 879/1792] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:05 2022] POST /identity/v3/projects => generated 371 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:05.418640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:05.472534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b480e30c-66db-4b40-8289-9cba7056c7b9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:05.602432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:05.659479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:05.665870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce7003-3732-42b6-a4d1-e06798c5a827 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:05.692578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:05.694365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:05.694770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:05.694984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:05.699536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:05.705753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:05.844948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:05.845615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:05.845898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:05.850709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 880/1793] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:05 2022] POST /identity/v3/users => generated 292 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:05.854438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] PATH_INFO: `/v3/projects/7bc86bec44d94a76951bcf5623bb9d30` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:05.855601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:05.858189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc86bec44d94a76951bcf5623bb9d30)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:05.873018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:05.884626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae1e51-7ad8-42a9-98a9-089859d70044 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:05.905085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:05.905745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:05.906076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:05.906274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:05.906926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:05.908631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:05.934000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 881/1794] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:05.936771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:05.965036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f4a84-8c1e-4d09-a533-8221de0bb469 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:05.993150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc86bec44d94a76951bcf5623bb9d30', 'request_id': 'req-65f58cb8-0a67-4976-96e2-fbc10fac5490'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.015331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc86bec44d94a76951bcf5623bb9d30', 'request_id': 'req-65f58cb8-0a67-4976-96e2-fbc10fac5490'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.052586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc86bec44d94a76951bcf5623bb9d30', 'request_id': 'req-65f58cb8-0a67-4976-96e2-fbc10fac5490'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.097595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] The token cache is being invalidate because project 7bc86bec44d94a76951bcf5623bb9d30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:06.098487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.099480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.106350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 914/1795] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:05 2022] DELETE /identity/v3/projects/7bc86bec44d94a76951bcf5623bb9d30 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:06.118727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:06.133074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:06.222510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:06.223202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:06.223493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:06.223752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] PATH_INFO: `/v3/projects/351f5f54df1a4d9994ea2733755685c0/users/440da48506ac4677a5da775d05da6993/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:06.281336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=351f5f54df1a4d9994ea2733755685c0, user_id=440da48506ac4677a5da775d05da6993, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:06.286098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:06.344448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 882/1796] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:05 2022] PUT /identity/v3/projects/351f5f54df1a4d9994ea2733755685c0/users/440da48506ac4677a5da775d05da6993/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:06.348216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:06.352119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:06.388654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f58cb8-0a67-4976-96e2-fbc10fac5490 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:06.473436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce8cc6-a576-4d92-8cb3-565553ba1e3e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:06.480809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:06.481746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:06.482113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:06.482414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:06.483202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:06.485207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:06.499893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 883/1797] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:06 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:06.504790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:06.522530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a372265-8158-4fa5-b0d2-027b1f5fad05 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:06.529240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:06.529912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:06.530192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:06.530475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] PATH_INFO: `/v3/projects/351f5f54df1a4d9994ea2733755685c0/users/440da48506ac4677a5da775d05da6993/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:06.532529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] RBAC: Authorizing `identity:create_grant(project_id=351f5f54df1a4d9994ea2733755685c0, user_id=440da48506ac4677a5da775d05da6993, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:06.537760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde8fe6-ced2-486a-a830-33a016a7dbea admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:06.553932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 884/1798] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:06 2022] PUT /identity/v3/projects/351f5f54df1a4d9994ea2733755685c0/users/440da48506ac4677a5da775d05da6993/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:06.562840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:06.564507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:06.571028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:06.686070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] MFA Rules not processed for user `440da48506ac4677a5da775d05da6993`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:06.690934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:06.705156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:06.708843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:06.715041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:06.715638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] PATH_INFO: `/v3/users/1209d64f070f43c98a118d9cffba9a4c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:06.718572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1209d64f070f43c98a118d9cffba9a4c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:06.721856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:06.744611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:06.759649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:06.836906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1209d64f070f43c98a118d9cffba9a4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.852223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1209d64f070f43c98a118d9cffba9a4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.876708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1209d64f070f43c98a118d9cffba9a4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.878487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1209d64f070f43c98a118d9cffba9a4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.895525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 885/1799] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:06.909296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:06.913774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:06.930340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1209d64f070f43c98a118d9cffba9a4c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:06.949204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 915/1800] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:06 2022] DELETE /identity/v3/users/1209d64f070f43c98a118d9cffba9a4c => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:07.041509 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba764620-6219-4d6d-a424-4b5b89925d45 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:07.141559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:07.142624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:07.143115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:07.143764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:07.149418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:07.355382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:07.371439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:07.417407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 886/1801] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:07.540110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:07.543330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:07.858063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b4f60-d8d5-4737-b5b8-d3cff5211b78 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:07.874460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:07.876546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:07.877458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:07.879040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] PATH_INFO: `/v3/projects/a018162f1fa44791a0003c36ee41c780` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:07.886758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a018162f1fa44791a0003c36ee41c780)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:07.894847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:08.060045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a018162f1fa44791a0003c36ee41c780', 'request_id': 'req-4c13f08f-db21-4bd7-86c3-b2bee2edf982'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.083934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a018162f1fa44791a0003c36ee41c780', 'request_id': 'req-4c13f08f-db21-4bd7-86c3-b2bee2edf982'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.145411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a018162f1fa44791a0003c36ee41c780', 'request_id': 'req-4c13f08f-db21-4bd7-86c3-b2bee2edf982'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.160150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] The token cache is being invalidate because project a018162f1fa44791a0003c36ee41c780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:08.160656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.172598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c13f08f-db21-4bd7-86c3-b2bee2edf982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.181792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 916/1802] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:07 2022] DELETE /identity/v3/projects/a018162f1fa44791a0003c36ee41c780 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:08.183542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:08.210431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1fb4a8-002c-4847-9b8d-d11c9e12f0f3 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:08.247824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:08.390706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec1fd2-8811-4556-8d00-7c70a3e3e69f None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:08.390706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec1fd2-8811-4556-8d00-7c70a3e3e69f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:08.390706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec1fd2-8811-4556-8d00-7c70a3e3e69f None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:08.392272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 917/1803] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:57:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:57:08.399528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:08.400109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:08.400414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:08.400678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] PATH_INFO: `/v3/users/22d71ce31a724ee89e7514621a167c7f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:08.423103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d71ce31a724ee89e7514621a167c7f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:08.430047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:08.471303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:08.472191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:08.472665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:08.550705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:08.557403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:08.640515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:08.641972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d71ce31a724ee89e7514621a167c7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.643498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d71ce31a724ee89e7514621a167c7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.666453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d71ce31a724ee89e7514621a167c7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.686151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d71ce31a724ee89e7514621a167c7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.746392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d71ce31a724ee89e7514621a167c7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:08.768057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 887/1804] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:08 2022] DELETE /identity/v3/users/22d71ce31a724ee89e7514621a167c7f => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:08.770553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:08.777482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:08.879392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 918/1805] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:57:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:08.944370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:08.946503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:08.984329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b439f6-51d4-450b-99eb-75354f71ce07 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:09.216378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f25aa57-999e-4557-8863-8226f65eaab5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:09.231817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:09.232785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:09.233343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:09.233730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] PATH_INFO: `/v3/users/ec1aba995c32483095400d8205861d9b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:09.238437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1aba995c32483095400d8205861d9b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:09.243424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:09.279014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:09.282732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:09.283024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:09.283301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:09.326921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:09.334920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1c60d-d48a-48b8-ad12-6d6a16b612f2 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:09.391023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 919/1806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:09.394371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:09.426462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1aba995c32483095400d8205861d9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:09.427897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1aba995c32483095400d8205861d9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:09.447154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1aba995c32483095400d8205861d9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:09.462495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1aba995c32483095400d8205861d9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:09.497154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1aba995c32483095400d8205861d9b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:09.512876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 888/1807] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:08 2022] DELETE /identity/v3/users/ec1aba995c32483095400d8205861d9b => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:09.521442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:09.521738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:09.522016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:09.577115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:09.582039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:09.714378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 920/1808] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:09.861317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:09.864190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:10.006838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21926fed-c458-4533-aec0-447dd1f512fe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:10.013768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:10.016067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:10.017454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:10.018685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:10.059253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:10.064256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71e395-5aa9-4910-a462-d6072fa70e08 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:10.081656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 889/1809] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:10.920918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:10.922369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:10.948798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda72fb-c2ca-4a21-90a5-302716a8dc36 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:10.960751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:10.961421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:10.961697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:10.962134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] PATH_INFO: `/v3/projects/1c2524f263464a39af0b2d45a7c3d69c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:10.964312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c2524f263464a39af0b2d45a7c3d69c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:10.984889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:11.082129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:11.101068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c2524f263464a39af0b2d45a7c3d69c', 'request_id': 'req-f09b2298-2f7a-4036-b244-078b3a010686'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.113527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c2524f263464a39af0b2d45a7c3d69c', 'request_id': 'req-f09b2298-2f7a-4036-b244-078b3a010686'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.139267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c2524f263464a39af0b2d45a7c3d69c', 'request_id': 'req-f09b2298-2f7a-4036-b244-078b3a010686'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.157604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] The token cache is being invalidate because project 1c2524f263464a39af0b2d45a7c3d69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:11.159243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.160282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f09b2298-2f7a-4036-b244-078b3a010686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.165273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 921/1810] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:10 2022] DELETE /identity/v3/projects/1c2524f263464a39af0b2d45a7c3d69c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:11.170851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.171352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.171878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.229854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:11.231100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:11.495263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 890/1811] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:11.502988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.503496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.503777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.532989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:11.534195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:11.546251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 922/1812] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:11.546437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:11.546437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:11.550648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:11.574286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f90807-26b6-48af-9a9e-415b6820e00e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:11.577925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62159c6d-090c-4180-84a8-ae744fb74a89 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:11.587648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:11.588290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.588983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.588983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.589560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:11.589865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:11.593575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:11.594241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.594520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.594787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] PATH_INFO: `/v3/projects/d501c8b8af974d5c96e253d61701fd43` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.595762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:11.598072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d501c8b8af974d5c96e253d61701fd43)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:11.600088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:11.618699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 923/1813] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:11.625681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:11.657841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600eb031-f518-4e62-b59f-44e8beadb04e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:11.666784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:11.669372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.672907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.673215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.675429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:11.682718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:11.720687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd501c8b8af974d5c96e253d61701fd43', 'request_id': 'req-f0fd77b0-e52d-4323-af46-a1981065b620'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.741091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 924/1814] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:11.744627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:11.748742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:11.754354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd501c8b8af974d5c96e253d61701fd43', 'request_id': 'req-f0fd77b0-e52d-4323-af46-a1981065b620'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.776110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd501c8b8af974d5c96e253d61701fd43', 'request_id': 'req-f0fd77b0-e52d-4323-af46-a1981065b620'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.792441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] The token cache is being invalidate because project d501c8b8af974d5c96e253d61701fd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:11.792698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.793507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f0fd77b0-e52d-4323-af46-a1981065b620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:11.799744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 891/1815] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:11 2022] DELETE /identity/v3/projects/d501c8b8af974d5c96e253d61701fd43 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:11.801359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7ef6-429b-419c-ba78-b21d9d3b3278 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.801711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7ef6-429b-419c-ba78-b21d9d3b3278 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.802066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f7ef6-429b-419c-ba78-b21d9d3b3278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.839270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-788f7ef6-429b-419c-ba78-b21d9d3b3278 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:11.844060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-788f7ef6-429b-419c-ba78-b21d9d3b3278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:11.910535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b8ffb-e493-4144-bc25-ce1f7aa3bc40 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:11.930212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:11.930879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.931166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.931443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.933970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:11.940653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ca198b-53ec-443d-a628-cf26eccdf9d3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:11.946855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 892/1816] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:11.968715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.969004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.969333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:11.985747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 925/1817] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/users => generated 285 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:11.985747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:11.985747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:11.985747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.007270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] MFA Rules not processed for user `7bb057384cf94a249c95fce8f7eff4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:12.008546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.023376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:12.024625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.054001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 893/1818] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:12.054913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.056900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.073421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29869a2c-d43c-4d7f-b79a-53b200f6275e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.079858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.081140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.081424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.081766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.082532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.084897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.100813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 894/1819] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:12.105018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.117515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c70f314-c7d1-4177-af67-24a23687d8c9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.124673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.124896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.125157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.125431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.126080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:12.126384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.128679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.151760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 895/1820] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:12.152700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.163266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 926/1821] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:12.163266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.168119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c74fc-fe5d-49a1-b988-d79954f43915 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.184526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.185146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.185569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.185843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.186664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.188647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.191214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b99bb6-06cb-4073-a90d-e2a3b2825c28 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.203044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.203884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.204439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.205109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.205426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 896/1822] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:12.205957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.206464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.211761 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.221471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788e9a9-4682-41bc-b12b-d4cf001667a8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.227180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.227844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.228125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.228425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] PATH_INFO: `/v3/projects/39824fa08b724d6ebaa7f737eb914daa/users/a3f1ee030eb643a08aa2029766552317/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.237313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:12.254068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39824fa08b724d6ebaa7f737eb914daa, user_id=a3f1ee030eb643a08aa2029766552317, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.261759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 927/1823] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:12.261960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9bb0d-88c2-4ea2-861e-d324aba668d4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.265627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.288442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 897/1824] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:12 2022] PUT /identity/v3/projects/39824fa08b724d6ebaa7f737eb914daa/users/a3f1ee030eb643a08aa2029766552317/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:12.302907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.303705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.304316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.359337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] MFA Rules not processed for user `a3f1ee030eb643a08aa2029766552317`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:12.360620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.371128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861ac07-8d6d-4216-801b-337c5f95a430 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.445079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.445646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.445926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.446201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.446831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.449666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.483915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 928/1825] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:12.485363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.486093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 898/1826] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:12.487804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.488587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.500880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef7f8b-5195-4c70-9cf9-340a9bebb655 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.506211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.507052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.507400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.507742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.508532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.510218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.511295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655db06b-efb2-4335-aafd-66f68ff9f0a1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.512490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:12.520027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.520760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.521036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.521304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] PATH_INFO: `/v3/projects/90e6699a75c54e389669385dc3f1935e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.523488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=90e6699a75c54e389669385dc3f1935e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.525391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.529493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 899/1827] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:12.530460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.542492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e707a-149b-4a28-9ac2-ca488342a0b5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.548858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.549478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.549763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.550039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.550675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.553221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.602595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 900/1828] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/projects => generated 367 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:12.602595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.611495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90e6699a75c54e389669385dc3f1935e', 'request_id': 'req-b73fe797-18a6-42a4-961f-0373095afd3c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.617638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90e6699a75c54e389669385dc3f1935e', 'request_id': 'req-b73fe797-18a6-42a4-961f-0373095afd3c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.632879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90e6699a75c54e389669385dc3f1935e', 'request_id': 'req-b73fe797-18a6-42a4-961f-0373095afd3c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.657675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] The token cache is being invalidate because project 90e6699a75c54e389669385dc3f1935e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:12.657966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.660974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.663396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 929/1829] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:12 2022] DELETE /identity/v3/projects/90e6699a75c54e389669385dc3f1935e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:12.664669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.668055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.690814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:12.696372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ad657-8884-4ec9-922b-ff8098da2406 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.702919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.703539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.703820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.704089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.704928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.706743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.722257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 901/1830] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:12.722257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.722257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.742471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c5988-532d-4bd2-aef0-ef2c7a70391a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.749556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.750169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.750456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.750733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] PATH_INFO: `/v3/users/440da48506ac4677a5da775d05da6993` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.752024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440da48506ac4677a5da775d05da6993)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.753888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.760747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fe797-18a6-42a4-961f-0373095afd3c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.768604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.769667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.770100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.776886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.776886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.776886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.821274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440da48506ac4677a5da775d05da6993'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.822213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440da48506ac4677a5da775d05da6993'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.828355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 930/1831] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:12.829988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.833301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.834400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440da48506ac4677a5da775d05da6993'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.847281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440da48506ac4677a5da775d05da6993'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.850657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5696ac7-477a-4bcf-b0fb-9f5fefbbbde4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:12.856888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:12.857670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.858145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.858479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] PATH_INFO: `/v3/projects/05e7359cfc74404d81e12f464ea9a3d8/users/1977cc72cee941e19cb42b16ae4fd4ae/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.869248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440da48506ac4677a5da775d05da6993'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:12.876870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e7359cfc74404d81e12f464ea9a3d8, user_id=1977cc72cee941e19cb42b16ae4fd4ae, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:12.882265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 902/1832] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:12 2022] DELETE /identity/v3/users/440da48506ac4677a5da775d05da6993 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:12.882406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f89bb20-149a-49d0-9378-bdc44449e4dd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:12.882481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:12.883300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.906348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 931/1833] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:12 2022] PUT /identity/v3/projects/05e7359cfc74404d81e12f464ea9a3d8/users/1977cc72cee941e19cb42b16ae4fd4ae/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:12.910759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:12.911122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:12.911467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:12.946389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] MFA Rules not processed for user `1977cc72cee941e19cb42b16ae4fd4ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:12.948077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:12.989346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:13.023718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a672ef-cc18-46a1-8f40-86044d08d162 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.044531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 932/1834] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:13.046552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.054112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:13.111150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.132914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.134378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.135075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.137798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.142558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.163559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 903/1835] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:13.168451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.182479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf6277-7f0e-42e8-877a-f05abb0b9651 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.186452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26d997-c130-4817-abfb-1b88133e18dd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.191712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.193992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.194746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.195634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.195894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.196271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.197229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.197668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.200298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.200776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] PATH_INFO: `/v3/projects/638c54f3bd724f6bb1ca752d333f0011/users/513bb4cedff44f5b9f68728def7ec928/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.215100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:13.231637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=638c54f3bd724f6bb1ca752d333f0011, user_id=513bb4cedff44f5b9f68728def7ec928, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.235752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.246086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 933/1836] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:13 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:13.253809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.269902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 904/1837] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:13 2022] PUT /identity/v3/projects/638c54f3bd724f6bb1ca752d333f0011/users/513bb4cedff44f5b9f68728def7ec928/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:13.271889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.364674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449c83-f478-4459-9896-54379ab35253 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.372516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.374942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.375256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.375532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.376249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.381837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.404027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 905/1838] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:13.405012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.417720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b992cfd-9a46-46e4-a2e3-a44ae46191f6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.426589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.427392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.427719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.427995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] PATH_INFO: `/v3/projects/638c54f3bd724f6bb1ca752d333f0011/users/513bb4cedff44f5b9f68728def7ec928/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.429673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ebf17-e47e-4695-b66b-5969ee86c205 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.433780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=638c54f3bd724f6bb1ca752d333f0011, user_id=513bb4cedff44f5b9f68728def7ec928, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.440160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5a976-4ea8-4a7b-97f0-d9b53f79b53d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.441056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.441797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.442363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.446421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.447258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.451371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.464339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 906/1839] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:13 2022] PUT /identity/v3/projects/638c54f3bd724f6bb1ca752d333f0011/users/513bb4cedff44f5b9f68728def7ec928/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:13.494568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 934/1840] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:13 2022] POST /identity/v3/users => generated 300 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:13.499063 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.500111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.503751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.504247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.518461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea222eac-5697-4093-9ad4-cc4d88f3d4d3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.591430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] MFA Rules not processed for user `513bb4cedff44f5b9f68728def7ec928`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:13.592864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:13.652797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.654124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:13.655450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.655873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.656895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.660901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.664102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.688619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 935/1841] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:13.689860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.716191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c29ea4-9704-4d1d-9075-d50008a44f89 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.722703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.723583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.723977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.724361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] PATH_INFO: `/v3/projects/a8ab451565d44f3999ee16e578d597f5/users/a503005d36704ab0ba7ce087990b2377/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.744953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ab451565d44f3999ee16e578d597f5, user_id=a503005d36704ab0ba7ce087990b2377, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.748753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 907/1842] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:13.752984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.759951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.762965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:13.796041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 936/1843] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:13 2022] PUT /identity/v3/projects/a8ab451565d44f3999ee16e578d597f5/users/a503005d36704ab0ba7ce087990b2377/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:13.800651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:13.914552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17818a95-b8b4-4e7e-886f-7c22e21e12b3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.930514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:13.950293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e41e8-37d8-4761-b322-9b8a2f7aa540 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:13.958970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.961242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.961536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.961814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:13.962477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:13.964133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:13.995188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:13.995639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:13.995959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:13.996245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.003023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 937/1844] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:14.004439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:14.027995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac32dde-2320-41a6-b82c-2ecb1d4431b4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:14.041699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:14.042882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.043568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.044985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] PATH_INFO: `/v3/projects/a8ab451565d44f3999ee16e578d597f5/users/a503005d36704ab0ba7ce087990b2377/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.048758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ab451565d44f3999ee16e578d597f5, user_id=a503005d36704ab0ba7ce087990b2377, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.052048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf50ec3-8a7d-4a1b-a55c-06e27fa5e71f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.068559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 938/1845] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:14 2022] PUT /identity/v3/projects/a8ab451565d44f3999ee16e578d597f5/users/a503005d36704ab0ba7ce087990b2377/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:14.082626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.082941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.083296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.117754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] MFA Rules not processed for user `a503005d36704ab0ba7ce087990b2377`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:14.119086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.164305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.170854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.225491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 908/1846] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:14.230321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:14.233031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.298548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 939/1847] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:14.303377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:14.305742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.309307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5171167-0896-49ad-8d1a-a94efc9039fe service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:14.399299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:14.436257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:14.436966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.437265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.437762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] PATH_INFO: `/v3/projects/351f5f54df1a4d9994ea2733755685c0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.438970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=351f5f54df1a4d9994ea2733755685c0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.442501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.484690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1851e-9607-42ac-a551-d74eb2824abc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:14.489781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:14.490875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.491307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.491726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.510719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.512843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd588f4-4e9f-47e9-bca6-bde764b79906 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.536925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 940/1848] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:14.547221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351f5f54df1a4d9994ea2733755685c0', 'request_id': 'req-023aa47a-60f7-48a8-8059-041c07998ea9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.568721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351f5f54df1a4d9994ea2733755685c0', 'request_id': 'req-023aa47a-60f7-48a8-8059-041c07998ea9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.589203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351f5f54df1a4d9994ea2733755685c0', 'request_id': 'req-023aa47a-60f7-48a8-8059-041c07998ea9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.605541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] The token cache is being invalidate because project 351f5f54df1a4d9994ea2733755685c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:14.605920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.607075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.609887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 909/1849] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:14 2022] DELETE /identity/v3/projects/351f5f54df1a4d9994ea2733755685c0 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:14.614994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b8b6-ef06-4c4e-bb3a-58ed1fb5b413 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.615280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b8b6-ef06-4c4e-bb3a-58ed1fb5b413 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.615623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb2b8b6-ef06-4c4e-bb3a-58ed1fb5b413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.640853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-abb2b8b6-ef06-4c4e-bb3a-58ed1fb5b413 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:14.641351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-abb2b8b6-ef06-4c4e-bb3a-58ed1fb5b413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.690107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:14.692054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.795218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 941/1850] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:14.804695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.806499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.806973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.821115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:14.852341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa47a-60f7-48a8-8059-041c07998ea9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:14.859885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:14.863961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:14.877086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:14.877962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.878236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.878599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] PATH_INFO: `/v3/users/1977cc72cee941e19cb42b16ae4fd4ae` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.879854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1977cc72cee941e19cb42b16ae4fd4ae)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.882274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.901532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 942/1851] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:14.924074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:14.953446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145cf2a-b027-4c1a-add3-c3224f068e03 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:14.968808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1977cc72cee941e19cb42b16ae4fd4ae'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.969581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:14.969727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1977cc72cee941e19cb42b16ae4fd4ae'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:14.970533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:14.973068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:14.973803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:14.976611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:14.977079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:14.984009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:14.984722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1977cc72cee941e19cb42b16ae4fd4ae'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:15.000187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1977cc72cee941e19cb42b16ae4fd4ae'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:15.008128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:15.010087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 943/1852] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:15.026834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d9612933-490b-4092-959e-6407848b6c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1977cc72cee941e19cb42b16ae4fd4ae'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:15.029264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.032736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:15.042725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 910/1853] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:14 2022] DELETE /identity/v3/users/1977cc72cee941e19cb42b16ae4fd4ae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:15.047757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.048234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.048564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.051301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329ab99e-aa19-4068-8687-a4eff8eb371b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.076371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:15.077933 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:15.193378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 911/1854] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:15.205251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.205879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.206073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.206330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.206968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.209199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.211752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.214998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:15.281578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 944/1855] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:15 2022] POST /identity/v3/projects => generated 389 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:15.283238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.305903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0caead-4ed5-4207-878c-084a406c9200 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.413143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.416888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.419009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.419327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.448782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ddcfb8-3a30-4cb9-9720-cae56bb99910 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.454606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.457175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.457642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.458686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.459061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.459581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.460428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.469594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.490804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 912/1856] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:15.517570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 945/1857] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:15 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:15.524289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.554812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd1a40-edbf-46bc-bcc2-b6fe75e4ec17 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.562894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.563661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.564842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.566122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.566122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.571378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.599446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 913/1858] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:15.599600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.611970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a2ee84-293d-4183-ad61-671e457b06bf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.619008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.620582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.621068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.621689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.622959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.625029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18781c-445f-4f8e-97e7-4ec4faa332f7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.653431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.664749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 946/1859] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:15 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:15.671162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3fc3a-71f0-4937-933d-7e27b7aed9ca admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:15.680961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:15.682062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.682993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.683412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] PATH_INFO: `/v3/projects/5b8325d565fa491b863bc7885c99f0b5/users/83300f3c0ca248bcbfc8b504fd5a7d31/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.713080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b8325d565fa491b863bc7885c99f0b5, user_id=83300f3c0ca248bcbfc8b504fd5a7d31, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:15.716829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:15.755823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 914/1860] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:15 2022] PUT /identity/v3/projects/5b8325d565fa491b863bc7885c99f0b5/users/83300f3c0ca248bcbfc8b504fd5a7d31/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:15.767309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:15.767610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:15.767895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:15.805049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] MFA Rules not processed for user `83300f3c0ca248bcbfc8b504fd5a7d31`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:15.806793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:15.897461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:15.966499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:15.970170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:15.989185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:15.997465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 947/1861] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:15 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:16.002173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.091611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0123049d-7610-44ad-b779-f34b636f4ab7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.100375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.101181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.101457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.101844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] PATH_INFO: `/v3/projects/05e7359cfc74404d81e12f464ea9a3d8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.102992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e7359cfc74404d81e12f464ea9a3d8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.105766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.122854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741ce66-afc1-415d-8f72-70270900b356 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.134655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.135332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.135612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.135894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.136568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.138527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.192843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 948/1862] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:16 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:16.197991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.200047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e7359cfc74404d81e12f464ea9a3d8', 'request_id': 'req-83303321-ef23-44b9-beb5-3f6a10de4e44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.219876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e7359cfc74404d81e12f464ea9a3d8', 'request_id': 'req-83303321-ef23-44b9-beb5-3f6a10de4e44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.248665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e7359cfc74404d81e12f464ea9a3d8', 'request_id': 'req-83303321-ef23-44b9-beb5-3f6a10de4e44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.283022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] The token cache is being invalidate because project 05e7359cfc74404d81e12f464ea9a3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:16.283324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.292220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.295782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 915/1863] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:15 2022] DELETE /identity/v3/projects/05e7359cfc74404d81e12f464ea9a3d8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:16.299324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.301106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.304841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c807fcc-f7f8-4288-bd94-ab4c22550357 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.313875 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.314501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.325198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.325734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.326538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.329028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.354618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 949/1864] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:16 2022] POST /identity/v3/users => generated 301 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:16.358490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.361889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.394954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a93a8-bb40-4a8b-ae06-1eb6c446f2bb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.421040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.421774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.422151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.422516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.423256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.425286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.437898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 950/1865] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:16.442057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.453388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d388f93-763d-413f-bc20-38ee1bb2fc14 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.456708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83303321-ef23-44b9-beb5-3f6a10de4e44 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.458498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.459285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.460770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.461054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] PATH_INFO: `/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e/users/d92ac56dd6064d2b81f5c2b4b5191a44/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.469247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.469905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.470194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.470472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] PATH_INFO: `/v3/users/a503005d36704ab0ba7ce087990b2377` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.477360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a503005d36704ab0ba7ce087990b2377)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.479964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.486472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa8efd52ae046e1b755f35c7ab4a59e, user_id=d92ac56dd6064d2b81f5c2b4b5191a44, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.490030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.522668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 951/1866] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:16 2022] PUT /identity/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e/users/d92ac56dd6064d2b81f5c2b4b5191a44/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:16.523629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.548346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:16.558358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:16.565751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a503005d36704ab0ba7ce087990b2377'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.567224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a503005d36704ab0ba7ce087990b2377'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.584756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a503005d36704ab0ba7ce087990b2377'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.595166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a503005d36704ab0ba7ce087990b2377'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.610480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff70d11-b569-4b3b-b48a-d91903430710 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.612304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a503005d36704ab0ba7ce087990b2377'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.615499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.616166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.616384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.616698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.617379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.618907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 916/1867] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:16 2022] DELETE /identity/v3/users/a503005d36704ab0ba7ce087990b2377 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:16.620571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.633599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.634379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 952/1868] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:16.635847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.638516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.640457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.654756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f83528-f060-4a25-a687-d79b953781b0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.737267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.738085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.738419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.738674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] PATH_INFO: `/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e/users/d92ac56dd6064d2b81f5c2b4b5191a44/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.740923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa8efd52ae046e1b755f35c7ab4a59e, user_id=d92ac56dd6064d2b81f5c2b4b5191a44, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.744049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f30f0-5a6d-4519-b01f-261554fa8943 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.750527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778b16-3794-4bf6-adb2-3f98141ee572 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:16.758165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 953/1869] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:16 2022] PUT /identity/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e/users/d92ac56dd6064d2b81f5c2b4b5191a44/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:16.770290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.770652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.771228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.811341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] MFA Rules not processed for user `d92ac56dd6064d2b81f5c2b4b5191a44`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:16.812329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.835616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:16.836424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.836886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.837125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] PATH_INFO: `/v3/users/a3f1ee030eb643a08aa2029766552317` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.838452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f1ee030eb643a08aa2029766552317)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:16.840600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:16.913913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f1ee030eb643a08aa2029766552317'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.914633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f1ee030eb643a08aa2029766552317'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.930645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 954/1870] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:16.935327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f1ee030eb643a08aa2029766552317'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.942617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:16.944264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:16.944438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f1ee030eb643a08aa2029766552317'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.952945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:16.963081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a51d356-60c9-404a-a6ea-0f99ecf26928 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f1ee030eb643a08aa2029766552317'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:16.973874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 917/1871] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:16 2022] DELETE /identity/v3/users/a3f1ee030eb643a08aa2029766552317 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:16.975671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:16.976060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:16.976464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:16.999482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:17.000786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.018447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:17.059249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651654a2-914b-43f5-8fe3-52ccf3535e8e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.094481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 918/1872] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:17.099920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.101681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.116758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f882d7-156b-4a23-bb69-a524cc868d80 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.123380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.124318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.124636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.124910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] PATH_INFO: `/v3/projects/a8ab451565d44f3999ee16e578d597f5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.126653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ab451565d44f3999ee16e578d597f5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.128871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.130990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.131675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.132027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.132369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.134362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.191834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ab451565d44f3999ee16e578d597f5', 'request_id': 'req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.198126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ab451565d44f3999ee16e578d597f5', 'request_id': 'req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.207924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ab451565d44f3999ee16e578d597f5', 'request_id': 'req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.216075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.217549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf51a421-736c-434d-a154-e98b5498fc0c service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.223154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] The token cache is being invalidate because project a8ab451565d44f3999ee16e578d597f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:17.223493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.224407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.227048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 919/1873] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:17 2022] DELETE /identity/v3/projects/a8ab451565d44f3999ee16e578d597f5 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:17.227717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 955/1874] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:16 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:17.229444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.230986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.233600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.233881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.234154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.262694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:17.265307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.318972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e5d5f-2f69-4acb-a0a5-f718fa712002 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.323278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.323902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.324182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.324513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.326491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.355131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:17.396728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 956/1875] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:17.399566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.401469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.415483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef87079-df12-4a5b-abca-7ea0e70230b6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.417027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.419006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6df42-c21b-4c11-8eea-147c3ce1c317 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.422111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.422759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.423203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.423429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] PATH_INFO: `/v3/users/83300f3c0ca248bcbfc8b504fd5a7d31` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.427013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=83300f3c0ca248bcbfc8b504fd5a7d31)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.428985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.429732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 920/1876] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:17.430997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.431278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.432546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.458568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:17.460192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.472986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 921/1877] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:17.477140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:17.482412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.492704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83300f3c0ca248bcbfc8b504fd5a7d31'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.495290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002d4db-35c9-42c6-9928-4e58e348f16a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.509071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83300f3c0ca248bcbfc8b504fd5a7d31'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.511722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.512379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.512725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.514730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.517473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:17.520058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.523133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb7ae43-0899-41c8-afbe-c9a7c6effc12 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.527880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83300f3c0ca248bcbfc8b504fd5a7d31'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.528683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83300f3c0ca248bcbfc8b504fd5a7d31'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.548846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83300f3c0ca248bcbfc8b504fd5a7d31'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:17.556356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 957/1878] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:17 2022] DELETE /identity/v3/users/83300f3c0ca248bcbfc8b504fd5a7d31 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:17.557827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 922/1879] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:17.560646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.561358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.561748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.562128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.562542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.584471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:17.586093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.670635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011ac39-d453-4b42-8b5a-73fd7ae071aa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.679968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.680303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.680626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.681085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.681733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.685654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.700791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 923/1880] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:17.712384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.715360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:17.761865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 958/1881] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:17 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:17.763686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:17.824301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035edd70-0ff2-4d5b-8512-b1af51d22a1b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.909491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.910229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.910517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.910839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.926668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08994-936e-48b4-911d-1b876561ae59 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:17.927676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.931006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.938397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:17.941098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:17.943452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:17.943747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:17.946076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:17.947687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:17.948954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 924/1882] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:17.951426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:17.985013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 959/1883] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:17 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:17.989543 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.005952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e953325-8322-4ffb-8b58-dbe2754ab86e service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.012161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.013083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.014251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.014494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.015294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.017058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.030325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 925/1884] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:18.034557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.047791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91723ca-565e-4a96-b0b3-b1ca41696011 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.053580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.054278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.054631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.054977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.055811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.058228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b514ff0-efd8-4b6a-a047-8613bfa1e058 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.095988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 960/1885] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:18.100608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.118845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426fca46-7c22-4794-a3dc-39f7522946c8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.129579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.130392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.130684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.131013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] PATH_INFO: `/v3/projects/02aef3f42ec948448630b7b812bcb228/users/982ca43497834ca0b50c7816a0d901c5/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.152697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02aef3f42ec948448630b7b812bcb228, user_id=982ca43497834ca0b50c7816a0d901c5, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.156541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.179629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 926/1886] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:18 2022] PUT /identity/v3/projects/02aef3f42ec948448630b7b812bcb228/users/982ca43497834ca0b50c7816a0d901c5/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:18.190766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.191728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.192263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.230029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] MFA Rules not processed for user `982ca43497834ca0b50c7816a0d901c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:18.232739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:18.237523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:18.334964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 961/1887] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:18.340432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.455866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a720a64-1d1a-41f2-9e9f-bfe0b92d0498 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.470692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.476079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.477568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.477998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.479494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.482208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.535884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 927/1888] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:18 2022] POST /identity/v3/projects => generated 387 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:18.537564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.549993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67063f2-052f-4039-99e9-6fc17b8836c5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.626866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.627429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.627734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.628012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.628697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.631829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.670690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 962/1889] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:18 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:18.674791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.701590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270520d8-3405-41fd-b1c6-79d432097ab1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.709573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.710304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.710601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.710879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.712587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.713791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.746058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 928/1890] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:18.751591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.757991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.760958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:18.779185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bcf832-3b89-433c-b301-2a9333323442 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.787645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed8724-26ea-40b5-80b7-e2b93c2634ec admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.788074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.789284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.789843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.790298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] PATH_INFO: `/v3/projects/cdc232dc6a7f4de394b61ef537e49209/users/2c0ea2c91c4a4924909104a344ccd626/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.793399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.794113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.794467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.794817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] PATH_INFO: `/v3/projects/5b8325d565fa491b863bc7885c99f0b5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.796984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b8325d565fa491b863bc7885c99f0b5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.798423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.820136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc232dc6a7f4de394b61ef537e49209, user_id=2c0ea2c91c4a4924909104a344ccd626, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.823735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:18.866857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b8325d565fa491b863bc7885c99f0b5', 'request_id': 'req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:18.873138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 963/1891] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:18 2022] PUT /identity/v3/projects/cdc232dc6a7f4de394b61ef537e49209/users/2c0ea2c91c4a4924909104a344ccd626/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:18.877155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.877929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b8325d565fa491b863bc7885c99f0b5', 'request_id': 'req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:18.889242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b8325d565fa491b863bc7885c99f0b5', 'request_id': 'req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:18.910682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] The token cache is being invalidate because project 5b8325d565fa491b863bc7885c99f0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:18.911123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:18.911905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:18.914338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 929/1892] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:18 2022] DELETE /identity/v3/projects/5b8325d565fa491b863bc7885c99f0b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:18.918446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:18.921518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:18.961264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:18.979207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03626ceb-9ae1-4ed4-8e54-862df0b78eb7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:18.988840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:18.989481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:18.989766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:18.990051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:18.990709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:18.992341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.015384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 964/1893] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:18 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:19.015384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:19.015384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.029634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4de9f2-d0e1-4ac2-9796-30bd36b1d89c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.035309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.036251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.036572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.036854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] PATH_INFO: `/v3/projects/39824fa08b724d6ebaa7f737eb914daa` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.038108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39824fa08b724d6ebaa7f737eb914daa)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.040069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.043398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:19.064943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6d5ec-edfa-4a9d-9da4-5b19d73603f0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.075298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.076939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.077218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.077557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] PATH_INFO: `/v3/users/d92ac56dd6064d2b81f5c2b4b5191a44` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.081727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=d92ac56dd6064d2b81f5c2b4b5191a44)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.089796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.123074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39824fa08b724d6ebaa7f737eb914daa', 'request_id': 'req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.136106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39824fa08b724d6ebaa7f737eb914daa', 'request_id': 'req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.148731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39824fa08b724d6ebaa7f737eb914daa', 'request_id': 'req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.163855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] The token cache is being invalidate because project 39824fa08b724d6ebaa7f737eb914daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:19.164157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.164935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.167759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 965/1894] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:19 2022] DELETE /identity/v3/projects/39824fa08b724d6ebaa7f737eb914daa => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:19.168881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:19.170773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.201952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd92ac56dd6064d2b81f5c2b4b5191a44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.203364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd92ac56dd6064d2b81f5c2b4b5191a44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.239755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd92ac56dd6064d2b81f5c2b4b5191a44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.243446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2fc5f4-95bf-4ba7-8f3b-e196792f41d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.262244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.262947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.263231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.263509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] PATH_INFO: `/v3/projects/cdc232dc6a7f4de394b61ef537e49209/users/2c0ea2c91c4a4924909104a344ccd626/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.272318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdc232dc6a7f4de394b61ef537e49209, user_id=2c0ea2c91c4a4924909104a344ccd626, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.277525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.288938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd92ac56dd6064d2b81f5c2b4b5191a44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.323363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-74e5c2d5-a3d7-444e-a357-fc9a917403ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd92ac56dd6064d2b81f5c2b4b5191a44'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.323588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 966/1895] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:19 2022] PUT /identity/v3/projects/cdc232dc6a7f4de394b61ef537e49209/users/2c0ea2c91c4a4924909104a344ccd626/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:19.325115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:19.327479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.345567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 930/1896] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:18 2022] DELETE /identity/v3/users/d92ac56dd6064d2b81f5c2b4b5191a44 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:19.346908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.347270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.347617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.403596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] MFA Rules not processed for user `2c0ea2c91c4a4924909104a344ccd626`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:19.405327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.477002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23493334-aab3-46b7-a07a-88318f916103 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.517503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 931/1897] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:19.527114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:19.528737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:19.530098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.576579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:19.602855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.602855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.602855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.602855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] PATH_INFO: `/v3/users/513bb4cedff44f5b9f68728def7ec928` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.604302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=513bb4cedff44f5b9f68728def7ec928)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.604302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.625562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e9e5c8-5cca-411b-8208-b29ab6ef0cbb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.630395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.631118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.632521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.632878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.651392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.652959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.677934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 932/1898] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:19.678875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:19.682754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:19.688769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '513bb4cedff44f5b9f68728def7ec928'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.699204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '513bb4cedff44f5b9f68728def7ec928'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.708010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15949f44-89f6-4155-934e-a1274e58938c service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:19.709022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '513bb4cedff44f5b9f68728def7ec928'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.710314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '513bb4cedff44f5b9f68728def7ec928'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.715880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:19.717157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.717735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.718220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] PATH_INFO: `/v3/users/c5b1a4ef16184214b7a07fca0297a391` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.720448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b1a4ef16184214b7a07fca0297a391)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:19.723276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:19.729550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0468d094-dac1-471b-a341-84bc6704dac0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '513bb4cedff44f5b9f68728def7ec928'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.738996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 967/1899] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:19 2022] DELETE /identity/v3/users/513bb4cedff44f5b9f68728def7ec928 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:19.803028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b1a4ef16184214b7a07fca0297a391'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.808703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b1a4ef16184214b7a07fca0297a391'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.832888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b1a4ef16184214b7a07fca0297a391'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.848944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b1a4ef16184214b7a07fca0297a391'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.874426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b1a4ef16184214b7a07fca0297a391'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:19.887025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 933/1900] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:19 2022] DELETE /identity/v3/users/c5b1a4ef16184214b7a07fca0297a391 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:19.892592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:19.892955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:19.893155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:19.920740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:19.921973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.024149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 968/1901] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:20.047434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:20.049425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.156545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f530cb5e-7727-4e8e-8702-a195f9975088 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:20.165239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:20.167082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:20.167550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:20.169094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:20.194570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:20.196911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18946db5-4c41-42ce-a128-8cbbd84d8bd8 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:20.217828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 934/1902] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:20.486253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:20.487704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.505632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdd4ca-4070-4aaa-a04d-e8af0425723c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:20.522754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:20.523422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:20.523706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:20.524004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] PATH_INFO: `/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:20.526831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa8efd52ae046e1b755f35c7ab4a59e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:20.533241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:20.630420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa8efd52ae046e1b755f35c7ab4a59e', 'request_id': 'req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:20.632571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:20.638480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa8efd52ae046e1b755f35c7ab4a59e', 'request_id': 'req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:20.654481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa8efd52ae046e1b755f35c7ab4a59e', 'request_id': 'req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:20.668984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] The token cache is being invalidate because project 4aa8efd52ae046e1b755f35c7ab4a59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:20.669285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:20.669966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:20.672625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 969/1903] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:20 2022] DELETE /identity/v3/projects/4aa8efd52ae046e1b755f35c7ab4a59e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:20.677254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:20.677733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:20.677834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:20.702504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:20.703746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.775107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:20.807231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:20.808788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.860967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 935/1904] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:20.862569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:20.868936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:20.904987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5b7b7-5684-4c14-b946-7172098e8cd2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:20.917874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:20.918599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:20.918864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:20.919132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] PATH_INFO: `/v3/projects/638c54f3bd724f6bb1ca752d333f0011` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:20.920772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=638c54f3bd724f6bb1ca752d333f0011)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:20.923703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:20.949773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab1eae-a240-4ec3-b3a3-b83332f35f70 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:20.958916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:20.961064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:20.961501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:20.961829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] PATH_INFO: `/v3/projects/1ed7c75fbf82429bbb278d75d23ec072` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:20.963315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ed7c75fbf82429bbb278d75d23ec072)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:20.966393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:20.997675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '638c54f3bd724f6bb1ca752d333f0011', 'request_id': 'req-1c3c6f38-2081-47e7-857b-4023efbde3e4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.008040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '638c54f3bd724f6bb1ca752d333f0011', 'request_id': 'req-1c3c6f38-2081-47e7-857b-4023efbde3e4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.023231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '638c54f3bd724f6bb1ca752d333f0011', 'request_id': 'req-1c3c6f38-2081-47e7-857b-4023efbde3e4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.041997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] The token cache is being invalidate because project 638c54f3bd724f6bb1ca752d333f0011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:21.042404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.042597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ed7c75fbf82429bbb278d75d23ec072', 'request_id': 'req-7e9b1715-d685-4623-892a-139509884b34'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.043209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.045107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 936/1905] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:20 2022] DELETE /identity/v3/projects/638c54f3bd724f6bb1ca752d333f0011 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:21.048928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.049426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ed7c75fbf82429bbb278d75d23ec072', 'request_id': 'req-7e9b1715-d685-4623-892a-139509884b34'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.052488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.077904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ed7c75fbf82429bbb278d75d23ec072', 'request_id': 'req-7e9b1715-d685-4623-892a-139509884b34'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.094516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] The token cache is being invalidate because project 1ed7c75fbf82429bbb278d75d23ec072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:21.095042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.096154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7e9b1715-d685-4623-892a-139509884b34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.097944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 970/1906] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:20 2022] DELETE /identity/v3/projects/1ed7c75fbf82429bbb278d75d23ec072 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:21.099462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e85ea-d693-46b9-b93a-ef0fb8249d8e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.099893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e85ea-d693-46b9-b93a-ef0fb8249d8e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.100317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e85ea-d693-46b9-b93a-ef0fb8249d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.122392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-491e85ea-d693-46b9-b93a-ef0fb8249d8e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:21.123904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-491e85ea-d693-46b9-b93a-ef0fb8249d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.145337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c6f38-2081-47e7-857b-4023efbde3e4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.186567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 971/1907] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:21.187831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.188143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.188442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.196709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:21.207693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.208354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.208646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.208810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:21.208908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] PATH_INFO: `/v3/users/982ca43497834ca0b50c7816a0d901c5` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.210059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982ca43497834ca0b50c7816a0d901c5)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.210452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.211975 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.218782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 972/1908] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:21.219770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.221074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.225935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:21.233663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c597c-5303-46a5-9b47-51f9a05c1264 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.238378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.239048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.239292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.239570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] PATH_INFO: `/v3/users/cc0bbfe6f0d6410ab3440994654bad90` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.240803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0bbfe6f0d6410ab3440994654bad90)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.242718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.262104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982ca43497834ca0b50c7816a0d901c5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.262703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982ca43497834ca0b50c7816a0d901c5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.271612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982ca43497834ca0b50c7816a0d901c5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.280134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982ca43497834ca0b50c7816a0d901c5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.292224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982ca43497834ca0b50c7816a0d901c5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.293068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0bbfe6f0d6410ab3440994654bad90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.299697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 937/1909] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:21 2022] DELETE /identity/v3/users/982ca43497834ca0b50c7816a0d901c5 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:21.300559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.301872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.303141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0bbfe6f0d6410ab3440994654bad90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.310256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0bbfe6f0d6410ab3440994654bad90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.310951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0bbfe6f0d6410ab3440994654bad90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.322946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ba6e392e-961b-4de9-98c2-10ed084e42db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0bbfe6f0d6410ab3440994654bad90'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.329013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 973/1910] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:21 2022] DELETE /identity/v3/users/cc0bbfe6f0d6410ab3440994654bad90 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:21.330422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b5a1-efe4-437b-9626-3f13a2b78cc0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.330710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b5a1-efe4-437b-9626-3f13a2b78cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.331035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7b5a1-efe4-437b-9626-3f13a2b78cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.354590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8cc7b5a1-efe4-437b-9626-3f13a2b78cc0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:21.356426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8cc7b5a1-efe4-437b-9626-3f13a2b78cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.371707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c66ba4-969a-42b6-9ddb-ea49c8678446 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.436187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 974/1911] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:21.437917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.438203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.438478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.449956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.450583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.450865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.451150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.451800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:21.452106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.453762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.460270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:21.462215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.466461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 938/1912] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:21.467574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.475550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 975/1913] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:21.476705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.477273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a3320-92dd-41c2-9b17-9a6540cdbbce admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.479104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.483481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.484107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.484419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.484767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.485511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:21.485818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.487428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.497009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7ab6-c960-4568-8404-24d909d9f22d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.502308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.502970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.503250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.503526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.504156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.506129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.515289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 939/1914] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:21.517127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.519043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.545372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 976/1915] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:21.545372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.546456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:21.591213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ce8a0-075a-4998-a85e-d0cd2f490779 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.604621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:21.622308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcc6a5-4773-4664-9995-5217191497db admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.634405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.635288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.635828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.636120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.636967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.638979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.663671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.664322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.664637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.664930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.675338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.676702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 977/1916] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:21.676808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.680549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.687285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 940/1917] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:21.688195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.689641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.703296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd03c5-0126-4f27-83e7-143f46e528bf service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.773234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.773784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.774064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.774349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] PATH_INFO: `/v3/projects/8bad8f84120346b585bfb874c53d255d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.776055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bad8f84120346b585bfb874c53d255d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.778163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.790244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d73f0-714c-409d-9bc0-2ac32540a0e3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.812038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:21.813089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:21.813562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:21.814040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:21.815156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:21.819258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:21.843909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bad8f84120346b585bfb874c53d255d', 'request_id': 'req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.851508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bad8f84120346b585bfb874c53d255d', 'request_id': 'req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.865935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 978/1918] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/users => generated 284 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:21.866219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bad8f84120346b585bfb874c53d255d', 'request_id': 'req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.867214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.883380 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e03bcba-6cdb-45a6-a916-798ea07c5f17 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:21.912927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] The token cache is being invalidate because project 8bad8f84120346b585bfb874c53d255d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:21.913403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.914628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:21.924439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 941/1919] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:21 2022] DELETE /identity/v3/projects/8bad8f84120346b585bfb874c53d255d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:21.925607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:21.927223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:21.939670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:22.012560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.013208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.013829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.013829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.014549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.017367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29cac2-1739-4356-a706-ca664f4ad501 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.044013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91e22a6-6d01-4edc-b8c8-2bfd4987f897 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.049144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 979/1920] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:21 2022] POST /identity/v3/users => generated 290 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:22.051283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.051283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.051283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.055054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.055961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.056449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.057563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.058565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.060653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.075978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 942/1921] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:21 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:22.079560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:22.080096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.082958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.085673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.090346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 980/1922] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:22.091513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.104886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f249fa-cade-4fbc-abe7-7437ba4ddaeb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.105997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c9fa1a-ebf6-44cf-be31-9fd00431598f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.111502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.111724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.112370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.112793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.112969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.113303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.113856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.114272 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.114393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.115160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.116276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252188a-af72-42e5-a090-043d94f43504 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.117075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.134199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 981/1923] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:22.134199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.134199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.134199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.138618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 943/1924] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:22.139707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.154178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e494d-2414-4f75-b3cd-c847e9ab5a9a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.160787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.161678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.162168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.162609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] PATH_INFO: `/v3/projects/a5653126da0d407e892dacd0bd20a202/users/05ce372a1c5c40c3ae4c1889a77b78bc/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.165174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:22.167060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.177629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 982/1925] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:22.179000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.187599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5653126da0d407e892dacd0bd20a202, user_id=05ce372a1c5c40c3ae4c1889a77b78bc, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.190997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.193040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534dd4e-df26-49cf-95e5-0f8a0651a612 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.201850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.202751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.203258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.203633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.204522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.206425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.221094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 983/1926] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:22.222244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.223666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 944/1927] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:22 2022] PUT /identity/v3/projects/a5653126da0d407e892dacd0bd20a202/users/05ce372a1c5c40c3ae4c1889a77b78bc/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:22.234213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.250139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15270b5c-bfd2-4e7b-8082-92ad127591a0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.284132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:22.329095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df697fcd-40ed-42c1-976b-4114b854ac7c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.341429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.342553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.342553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.342758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] PATH_INFO: `/v3/projects/61c7b2f70d084fc296425d68607b1c94/users/ece2284cedbd4f96a32e65803667e192/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.382793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c7b2f70d084fc296425d68607b1c94, user_id=ece2284cedbd4f96a32e65803667e192, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.390001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817ee181-cc12-43a8-883c-77cbe57e51ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.397949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.399880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.400653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.401841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.403259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:22.403924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.407241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be7c2b5-33ee-47c5-b785-3add6709134e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.432486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 945/1928] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:22 2022] PUT /identity/v3/projects/61c7b2f70d084fc296425d68607b1c94/users/ece2284cedbd4f96a32e65803667e192/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:22.432486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0ff0-2bf3-4624-94ab-677a028c6f62 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.432486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0ff0-2bf3-4624-94ab-677a028c6f62 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.432486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e0ff0-2bf3-4624-94ab-677a028c6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.456495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 984/1929] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:22.459185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.459302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.459712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.502894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-be9e0ff0-2bf3-4624-94ab-677a028c6f62 None None] MFA Rules not processed for user `05ce372a1c5c40c3ae4c1889a77b78bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:22.504751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-be9e0ff0-2bf3-4624-94ab-677a028c6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.511457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] MFA Rules not processed for user `ece2284cedbd4f96a32e65803667e192`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:22.513910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.625222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:22.675800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 985/1930] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:22.679654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.680871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 946/1931] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:22.682873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b542b-1e08-49fe-8341-eca8a0588d7e None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.683168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b542b-1e08-49fe-8341-eca8a0588d7e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.683444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b542b-1e08-49fe-8341-eca8a0588d7e None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.684794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 947/1932] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:57:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:57:22.685479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b542b-1e08-49fe-8341-eca8a0588d7e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.787158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b542b-1e08-49fe-8341-eca8a0588d7e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.804098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.805495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.805979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.806496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.807334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.811097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.817770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721695b-e2eb-42cf-9efc-f76bcce1be27 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:22.830079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:22.830851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.831170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.831412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.833862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:22.838294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021383-8389-444d-9d4e-bb8ca94d399b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:22.873773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 948/1933] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/projects => generated 381 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:22.874342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:22.888074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 986/1934] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/projects => generated 369 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:22.889792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:22.890084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:22.890361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:22.940858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:22.942174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:22.964538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:23.007848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda04f0f-a300-4998-be68-0dc8d164a23f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.053234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 987/1935] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:23.054323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.055818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.106778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.107755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.108235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.108771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.110334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.113211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.148213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202c086-2308-47b7-af79-bd2f34925d3c None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.149989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:23.156253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.157611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.158134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.158351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] PATH_INFO: `/v3/projects/02aef3f42ec948448630b7b812bcb228` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.160570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02aef3f42ec948448630b7b812bcb228)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.163054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.163758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 949/1936] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:22 2022] POST /identity/v3/projects => generated 367 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:23.164924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.232180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02aef3f42ec948448630b7b812bcb228', 'request_id': 'req-8d6243fb-2f35-4c48-abaf-e1b23b94a901'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.242594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02aef3f42ec948448630b7b812bcb228', 'request_id': 'req-8d6243fb-2f35-4c48-abaf-e1b23b94a901'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.252250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02aef3f42ec948448630b7b812bcb228', 'request_id': 'req-8d6243fb-2f35-4c48-abaf-e1b23b94a901'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.252699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535f5f8-fecc-4413-9d50-2dc3c094babf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.265307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] The token cache is being invalidate because project 02aef3f42ec948448630b7b812bcb228 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:23.265484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.267628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.271938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 988/1937] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:23 2022] DELETE /identity/v3/projects/02aef3f42ec948448630b7b812bcb228 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:23.271938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.271938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.323791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:23.324888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.325215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.325524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.326115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.326540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.329609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.350773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6243fb-2f35-4c48-abaf-e1b23b94a901 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.356312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.356890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.357516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 950/1938] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:23 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:23.358292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.360056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.360281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.360425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.361313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.363453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.391467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 989/1939] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:23 2022] POST /identity/v3/users => generated 285 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:23.392292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.393935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.407620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092c556-a561-47f7-85c4-761ee0bb6875 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.412836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.413505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.413790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.414065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.414693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.416749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.443394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 990/1940] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:23 2022] POST /identity/v3/users => generated 290 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:23.444603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.447872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.464984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad909d8-1f1c-4129-a129-c7b9a3f232ed admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.471270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.472110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.472560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.472912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] PATH_INFO: `/v3/users/2c0ea2c91c4a4924909104a344ccd626` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.474298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c0ea2c91c4a4924909104a344ccd626)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.475077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29748c58-3577-4b38-9d45-4da51b0ec54e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.476669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.482185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.482934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.483276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.483613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.485649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.507637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.512118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.526812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 951/1941] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:23.527690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.529224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.542811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7dc600-be4f-45bd-b0d5-70d3c393ce8b service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.547732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.548326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.548640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.548912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.549703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.551316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.555386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c0ea2c91c4a4924909104a344ccd626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.564160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 952/1942] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:23.565131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.573673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c0ea2c91c4a4924909104a344ccd626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.581115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78fc599-1b2b-4f38-8e14-6a6ccdf71565 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.584110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c0ea2c91c4a4924909104a344ccd626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.584871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c0ea2c91c4a4924909104a344ccd626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.586255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.586973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.587254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.587525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.588553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.590550 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.598375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:23.602669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c0ea2c91c4a4924909104a344ccd626'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:23.613034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 991/1943] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:23 2022] DELETE /identity/v3/users/2c0ea2c91c4a4924909104a344ccd626 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:23.613641 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.615787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.618109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 953/1944] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:23.619695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.624498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.640746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dca02e-de43-495d-b884-073af3a3808c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.763976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.764983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.764983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.765254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] PATH_INFO: `/v3/projects/65c776a6268a401ba0894f44aef345b2/users/cdf43ea51c54400bb3c5f5f0e7d21474/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.778448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b4b38-1746-49c3-bd2e-dbb9575df396 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.784686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.785317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.785630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.785904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.786568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.788166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.791229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c776a6268a401ba0894f44aef345b2, user_id=cdf43ea51c54400bb3c5f5f0e7d21474, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.795291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6f0c0-9192-4493-a83b-6e5246350b5a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.798983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 992/1945] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:23.799920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.801755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.819558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70199c9d-4f5a-40e5-83be-6ac3f1076eab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.835105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 954/1946] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:23 2022] PUT /identity/v3/projects/65c776a6268a401ba0894f44aef345b2/users/cdf43ea51c54400bb3c5f5f0e7d21474/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:23.836938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da03c6-d170-4764-8f03-11bd58a8ba3a None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.837217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da03c6-d170-4764-8f03-11bd58a8ba3a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.837751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da03c6-d170-4764-8f03-11bd58a8ba3a None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.839427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 955/1947] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:57:23.840093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da03c6-d170-4764-8f03-11bd58a8ba3a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.848906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=83,keystone:INSERT=7,keystone:DELETE=10 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:23.895838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.896653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.896932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.897386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.898362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.899765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.910463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 993/1948] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:23.911386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:23.923257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1442bd-265e-401f-a8f6-c9be1264131b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.928725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.929290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.929656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.929994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.930839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.933195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2dc323-3df6-42cd-9114-a2ad34564738 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:23.948442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 994/1949] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:23.949757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.950045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.950322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.952372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da03c6-d170-4764-8f03-11bd58a8ba3a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:23.957178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:23.957836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:23.958111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:23.958379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] PATH_INFO: `/v3/projects/cacc1c9f04524e50a3c4f5e873213b69/users/09ff8f6742f14afda331538a50fefa37/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:23.977075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:23.978848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:23.980693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacc1c9f04524e50a3c4f5e873213b69, user_id=09ff8f6742f14afda331538a50fefa37, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:23.984497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.005440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 956/1950] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:23 2022] PUT /identity/v3/projects/cacc1c9f04524e50a3c4f5e873213b69/users/09ff8f6742f14afda331538a50fefa37/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:24.006283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.099558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478606d-2dab-4dd5-a682-1bbe0ab4408a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.105978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.107188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.109438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.109438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] PATH_INFO: `/v3/projects/7e07d32263114b268ea9c61a3cd50de7/users/4f5cba49e44d4e65a0d358daa67c0ad3/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.121738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:24.126233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 995/1951] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:57:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:24.126617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e07d32263114b268ea9c61a3cd50de7, user_id=4f5cba49e44d4e65a0d358daa67c0ad3, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.130737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.131408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.158070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbca7f-d403-4576-94f3-9283548b04fc None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.161251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 957/1952] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:24 2022] PUT /identity/v3/projects/7e07d32263114b268ea9c61a3cd50de7/users/4f5cba49e44d4e65a0d358daa67c0ad3/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:24.162288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.234548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.235225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.235506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.235791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] PATH_INFO: `/v3/projects/65c776a6268a401ba0894f44aef345b2/users/cdf43ea51c54400bb3c5f5f0e7d21474/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.238444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c776a6268a401ba0894f44aef345b2, user_id=cdf43ea51c54400bb3c5f5f0e7d21474, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.241408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.259067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 996/1953] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:24 2022] PUT /identity/v3/projects/65c776a6268a401ba0894f44aef345b2/users/cdf43ea51c54400bb3c5f5f0e7d21474/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:24.260311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.262797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a3477e-3706-4f9c-bee2-beae187a5960 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.269888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.336539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:24.366039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.366585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.366864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.367135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.367779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.370218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c19ee4-86f7-4c30-a4d7-02795ec8b67a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.382780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cb27f-5f37-44c1-a374-45e6b41603a3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.389676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 958/1954] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:24.390886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.391174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.391453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.391917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.392989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.393473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.393919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] PATH_INFO: `/v3/projects/cdc232dc6a7f4de394b61ef537e49209` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.395991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdc232dc6a7f4de394b61ef537e49209)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.400013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.422474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] MFA Rules not processed for user `4f5cba49e44d4e65a0d358daa67c0ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:24.423712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.454738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdc232dc6a7f4de394b61ef537e49209', 'request_id': 'req-3f58c877-22d0-4de7-bb8c-7d27066dde48'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:24.460247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdc232dc6a7f4de394b61ef537e49209', 'request_id': 'req-3f58c877-22d0-4de7-bb8c-7d27066dde48'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:24.468950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdc232dc6a7f4de394b61ef537e49209', 'request_id': 'req-3f58c877-22d0-4de7-bb8c-7d27066dde48'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:24.480749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] The token cache is being invalidate because project cdc232dc6a7f4de394b61ef537e49209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:24.481291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:24.481939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f58c877-22d0-4de7-bb8c-7d27066dde48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:24.483726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 997/1955] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:24 2022] DELETE /identity/v3/projects/cdc232dc6a7f4de394b61ef537e49209 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:24.484674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.484953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.485251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.495556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 959/1956] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:24.495556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.495556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.512692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] MFA Rules not processed for user `cdf43ea51c54400bb3c5f5f0e7d21474`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:24.513894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.521064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:24.569605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7ac7a-11e6-4b74-a3c0-14a370dc509d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.589471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 998/1957] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:24.589471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.589471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.638958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:24.647035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.647656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.647939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.648219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.650625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.656441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91e63c-fd21-4071-847b-521fbc913a07 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.661595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.662377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.662674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.662943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] PATH_INFO: `/v3/projects/cacc1c9f04524e50a3c4f5e873213b69/users/09ff8f6742f14afda331538a50fefa37/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.663117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.664847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d376ef3-8266-477a-aaaa-7c5a44056173 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.664965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cacc1c9f04524e50a3c4f5e873213b69, user_id=09ff8f6742f14afda331538a50fefa37, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.668016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.676532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 960/1958] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:24.677906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.678182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.678520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.684104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 999/1959] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:24 2022] PUT /identity/v3/projects/cacc1c9f04524e50a3c4f5e873213b69/users/09ff8f6742f14afda331538a50fefa37/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:24.684104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.686097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.703567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:24.705056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.767346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cee3e-c6a2-4995-99ad-a4b49d2439b6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.776858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 961/1960] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:24.776858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:24.778390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.780022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.780685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.780968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.782011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.782690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.784629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee279e08-35b7-4dfe-aa80-9c5c42b7af74 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:24.818501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1000/1961] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:24.820073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd95-f28d-4a2f-8407-afc80a7b9112 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.820620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd95-f28d-4a2f-8407-afc80a7b9112 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.821139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061bfd95-f28d-4a2f-8407-afc80a7b9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.844831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:24.853607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b454c-2722-4e54-8141-5f06a6708c72 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:24.860295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-061bfd95-f28d-4a2f-8407-afc80a7b9112 None None] MFA Rules not processed for user `09ff8f6742f14afda331538a50fefa37`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:24.861916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-061bfd95-f28d-4a2f-8407-afc80a7b9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.912300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:24.913307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.913307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.913511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.949563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1001/1962] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:24.951152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:24.951756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:24.951756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:24.978300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:24.979699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:24.989802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:24.991954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.005442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 962/1963] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:25.006574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.043594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:25.068575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1002/1964] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:25.069446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.070787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:25.086252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0015f-096f-46b5-899b-28a6b82293db service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.088239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69fd08-b8b5-495d-a528-4c53e10adc95 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.091497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.092175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.092484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.092866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.093355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.094124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.094407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.094685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.099242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.101423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.122393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.124418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.135807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1003/1965] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:25.136743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.137598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 963/1966] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:25 2022] POST /identity/v3/users => generated 291 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:25.150541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.152271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710da6a2-f1a0-4c92-ac36-d9882d0f6269 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.159407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.160042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.160330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.160665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.161545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:25.161854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.169413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.175207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443dbe0-21d1-4abf-aa1b-a53b2d174935 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.184583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.185579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.186058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.186536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.187606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.189901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.190326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1004/1967] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:25.191471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.206970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 964/1968] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:25.208795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfde4ba-7657-46c9-8657-e04b3503708c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.211353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.219091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.219677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.219962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.220246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.223582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.225487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.230087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe58bb2-bb37-4792-b808-033121d13b67 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.237389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.238937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.239223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.239792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] PATH_INFO: `/v3/projects/9860e7178a3e47aa9393f5fdb3712d68/users/8728ff4d2b9a40f19ff8c4a051a89561/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.259443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9860e7178a3e47aa9393f5fdb3712d68, user_id=8728ff4d2b9a40f19ff8c4a051a89561, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.263021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.264581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1005/1969] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:25 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:25.269652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.283436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 965/1970] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:25 2022] PUT /identity/v3/projects/9860e7178a3e47aa9393f5fdb3712d68/users/8728ff4d2b9a40f19ff8c4a051a89561/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:25.286360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.294105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:25.354375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f16dc38-d062-45ab-9053-d9ef28278464 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.356626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09bb93-994f-47eb-afd3-a0ad17d9b235 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.361138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.362167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.362616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.362948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.366005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:25.481458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.482082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.482362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.483676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.484315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.486308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.499853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.501828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.526169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 966/1971] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:25.527175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.538415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1006/1972] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:25 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:25.539695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.550336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c12e3e-48e9-4c38-8b39-221ed37470d0 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.562175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.562544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.562811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.563088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.564032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.569709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.607444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 967/1973] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:25.611513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.633223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:25.643907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab891d19-062e-4d6a-8f2f-90ceb40dd22d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.658835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.660224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.661246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53f0d7-e713-4336-b917-99189f3b6d7d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.661630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.662702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.664442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.669253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.678461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf43ea51c54400bb3c5f5f0e7d21474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65c776a6268a401ba0894f44aef345b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.679107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.679404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.679683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.680863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:25.681178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.683389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.690998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 968/1974] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:25.691987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.702731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1007/1975] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:25.703843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.719066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8451829a-50b4-44d1-9492-325801cd1e0b tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.720584 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a4d21d-82e4-4bee-a4c3-274950e869d4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.740052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.740937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.741217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.741496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] PATH_INFO: `/v3/projects/9860e7178a3e47aa9393f5fdb3712d68/users/8728ff4d2b9a40f19ff8c4a051a89561/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.743356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.745037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.745506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.745959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.746782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.748589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.758032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9860e7178a3e47aa9393f5fdb3712d68, user_id=8728ff4d2b9a40f19ff8c4a051a89561, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.761305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.762907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1008/1976] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:25.764020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.778964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af57a2d-0a29-41ca-b4df-b82059082b33 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.794635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 969/1977] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:25 2022] PUT /identity/v3/projects/9860e7178a3e47aa9393f5fdb3712d68/users/8728ff4d2b9a40f19ff8c4a051a89561/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:25.795681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:25.904446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf43ea51c54400bb3c5f5f0e7d21474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65c776a6268a401ba0894f44aef345b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.905887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.906550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.906946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.907600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:25.910319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ac77d-1091-49ee-a557-315d2fee27a7 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:25.926868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554feff2-f425-42b4-bc77-9179d3a7833c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:25.946065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:25.946727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.947042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.947315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] PATH_INFO: `/v3/projects/301e65f716cd488fb43d8cddeba92f9e/users/25d9c65c90d14c52b484fe2bd68c6c4d/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:25.953261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1009/1978] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:25 2022] POST /identity/v3/projects => generated 355 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:25.955267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:25.955694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:25.956100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.002234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=301e65f716cd488fb43d8cddeba92f9e, user_id=25d9c65c90d14c52b484fe2bd68c6c4d, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.007274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.035263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 970/1979] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:25 2022] PUT /identity/v3/projects/301e65f716cd488fb43d8cddeba92f9e/users/25d9c65c90d14c52b484fe2bd68c6c4d/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:26.036664 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.047287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] MFA Rules not processed for user `8728ff4d2b9a40f19ff8c4a051a89561`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:26.047287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.077515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:26.189823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfeb5bc-799f-4ab5-9c81-0f6458357730 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.196661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf43ea51c54400bb3c5f5f0e7d21474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65c776a6268a401ba0894f44aef345b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.197915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.198311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.198723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.200119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:26.200728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.202693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9778fe87-eba3-40aa-bc3f-94f6b445d0b8 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.226151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 971/1980] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:26.228093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.228220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.228496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.242260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1010/1981] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:26.253672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.273966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] MFA Rules not processed for user `25d9c65c90d14c52b484fe2bd68c6c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:26.276232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.362630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:26.395971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f1151-7e57-4f65-85ae-cf589620aa26 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.398297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 972/1982] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:26.399037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.410817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.411093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.411379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.411724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.419177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5811ccdb-1968-4e5b-b665-9235ac37591c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.423076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.424567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.426681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cdf43ea51c54400bb3c5f5f0e7d21474', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '65c776a6268a401ba0894f44aef345b2', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.427558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.427987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.428613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] PATH_INFO: `/v3/projects/7e8486d1bb8e464bb94d5926d17b6e50` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.431214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7e8486d1bb8e464bb94d5926d17b6e50)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.435544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.439827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1011/1983] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:26.440714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.500211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8486d1bb8e464bb94d5926d17b6e50', 'request_id': 'req-1dc9b36b-d695-401c-9e4a-8fa254ce2318'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.505994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8486d1bb8e464bb94d5926d17b6e50', 'request_id': 'req-1dc9b36b-d695-401c-9e4a-8fa254ce2318'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.513649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8486d1bb8e464bb94d5926d17b6e50', 'request_id': 'req-1dc9b36b-d695-401c-9e4a-8fa254ce2318'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.514342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fd140-e2a3-4068-8cac-07418603bf47 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.525812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] The token cache is being invalidate because project 7e8486d1bb8e464bb94d5926d17b6e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:26.526116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.526763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.528268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 973/1984] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:26 2022] DELETE /identity/v3/projects/7e8486d1bb8e464bb94d5926d17b6e50 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:26.529071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.532682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.555467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:26.577691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.578312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.578596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.579118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.579747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.581697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.610172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9b36b-d695-401c-9e4a-8fa254ce2318 tempest-VolumeQuotaClassesTest-2039787304 tempest-VolumeQuotaClassesTest-2039787304-project-admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.616149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.616149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.616149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.616149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.616883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1012/1985] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:26 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:26.621565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.621848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.623598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.707401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.709241 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.725445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 974/1986] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:26.768812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff847afd-5fd3-47ca-8db7-617b1b88c46a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.776985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.777750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.778193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.778557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.779496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.781832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.799431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.801129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:26.804733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:26.813766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1013/1987] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:26 2022] POST /identity/v3/users => generated 296 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:26.817512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.823218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea61dd3-8d4c-487a-bd30-20d4ed447a2b service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.831638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.832362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.832833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.833127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da83ee-734a-40e3-8d65-30313bab2d1b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.833281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] PATH_INFO: `/v3/users/ece2284cedbd4f96a32e65803667e192` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.834987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece2284cedbd4f96a32e65803667e192)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.837982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.841845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.842961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.842961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.843367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.844591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.846603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.862096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1014/1988] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:26.865370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.879146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638cb31e-f925-4014-a1f3-6d8a8a4fca03 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:26.883973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:26.885442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.885723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.885918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] PATH_INFO: `/v3/projects/9547c7a2610e4a12b4a112bfb1802419/users/e749db415aad40e7af3e03a3a394a820/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.911978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece2284cedbd4f96a32e65803667e192'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.913247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece2284cedbd4f96a32e65803667e192'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.917329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9547c7a2610e4a12b4a112bfb1802419, user_id=e749db415aad40e7af3e03a3a394a820, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:26.920290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:26.926149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece2284cedbd4f96a32e65803667e192'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.939895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece2284cedbd4f96a32e65803667e192'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.941922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1015/1989] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:26 2022] PUT /identity/v3/projects/9547c7a2610e4a12b4a112bfb1802419/users/e749db415aad40e7af3e03a3a394a820/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:26.948510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:26.957274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f79701e6-0b3e-4267-8573-790aeb3c1b42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece2284cedbd4f96a32e65803667e192'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:26.964993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 975/1990] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:26 2022] DELETE /identity/v3/users/ece2284cedbd4f96a32e65803667e192 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:26.969012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:26.969433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:26.969714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:26.995000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:26.996199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.027119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d245a8b1-9f33-4fa9-b8c8-713fd982abd4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.041284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:27.085735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 976/1991] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:27.096063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.097559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.102105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.103743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.104205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.104809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.106806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.108746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.126675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1016/1992] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:26 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:27.133158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.135068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.165354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc30452c-4c76-488b-a033-e0bc35457a52 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.171640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.172536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.172819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.173124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] PATH_INFO: `/v3/projects/9547c7a2610e4a12b4a112bfb1802419/users/e749db415aad40e7af3e03a3a394a820/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.175107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9547c7a2610e4a12b4a112bfb1802419, user_id=e749db415aad40e7af3e03a3a394a820, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.177976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66795ae-04b7-4298-96d9-5005ed84b740 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.192490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be367f-6c5f-4621-b2f0-15e6d7c98dde None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.192930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1017/1993] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:27 2022] PUT /identity/v3/projects/9547c7a2610e4a12b4a112bfb1802419/users/e749db415aad40e7af3e03a3a394a820/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:27.204105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.204497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.204844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.234292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] MFA Rules not processed for user `e749db415aad40e7af3e03a3a394a820`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:27.235661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.265880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.266680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.266935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.267276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.288065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:27.321390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1018/1994] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:27 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:27.334152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.335613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.341829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.343282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.353761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 977/1995] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:27.425622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f284283-8e79-4ded-a2bb-e406065aa701 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.430864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.431536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.431890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.432445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.457817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.459638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.473955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1019/1996] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:27.764301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.765878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.782259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ec7cf-13e2-4540-84a2-b3c8ebbdbae0 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.787187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.787939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.788831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.789114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] PATH_INFO: `/v3/projects/61c7b2f70d084fc296425d68607b1c94` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.794346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c7b2f70d084fc296425d68607b1c94)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.796539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.843671 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:27.849051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c7b2f70d084fc296425d68607b1c94', 'request_id': 'req-470ecdc2-c280-4a79-a83e-995bd6dd7212'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:27.857181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c7b2f70d084fc296425d68607b1c94', 'request_id': 'req-470ecdc2-c280-4a79-a83e-995bd6dd7212'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:27.865455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c7b2f70d084fc296425d68607b1c94', 'request_id': 'req-470ecdc2-c280-4a79-a83e-995bd6dd7212'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:27.878879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] The token cache is being invalidate because project 61c7b2f70d084fc296425d68607b1c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:27.879316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:27.880017 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:27.881644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 978/1997] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:27 2022] DELETE /identity/v3/projects/61c7b2f70d084fc296425d68607b1c94 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:27.886042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.896699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:27.897200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9e1e6d-b67e-4fe5-bb30-a35026a24f51 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.898100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:27.963246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.963980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.964165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.964464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] PATH_INFO: `/v3/users/cdf43ea51c54400bb3c5f5f0e7d21474` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.965610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf43ea51c54400bb3c5f5f0e7d21474)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.967663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:27.974728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ecdc2-c280-4a79-a83e-995bd6dd7212 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:27.982379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:27.983219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:27.983593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:27.984044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] PATH_INFO: `/v3/users/25d9c65c90d14c52b484fe2bd68c6c4d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:27.985235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] RBAC: Authorizing `identity:delete_user(user_id=25d9c65c90d14c52b484fe2bd68c6c4d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:27.987725 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:28.039239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf43ea51c54400bb3c5f5f0e7d21474'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.051264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf43ea51c54400bb3c5f5f0e7d21474'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.058801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25d9c65c90d14c52b484fe2bd68c6c4d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.059522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25d9c65c90d14c52b484fe2bd68c6c4d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.065025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf43ea51c54400bb3c5f5f0e7d21474'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.066330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf43ea51c54400bb3c5f5f0e7d21474'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.069761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25d9c65c90d14c52b484fe2bd68c6c4d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.080599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25d9c65c90d14c52b484fe2bd68c6c4d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.084687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b5df93da-9172-4f20-a5e5-4cbd553f6ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf43ea51c54400bb3c5f5f0e7d21474'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.095714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1020/1998] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:27 2022] DELETE /identity/v3/users/cdf43ea51c54400bb3c5f5f0e7d21474 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:28.100814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25d9c65c90d14c52b484fe2bd68c6c4d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.108505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 979/1999] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:27 2022] DELETE /identity/v3/users/25d9c65c90d14c52b484fe2bd68c6c4d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:28.113075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.114051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.114625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.127198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:28.153870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:28.155610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:28.273568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1021/2000] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:28.281210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:28.282755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:28.369163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09478f68-f807-49d7-9bb6-cfa53f83412e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:28.373994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:28.374759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.375295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.375681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.390700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:28.396280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:28.398402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba887086-95fb-4614-954b-238be47e20cf service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:28.420821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 980/2001] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:28.516924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:28.519479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:28.550422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e655f49-d951-4f36-8b06-2083cc3983e3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:28.561889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:28.563358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.563728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.564096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] PATH_INFO: `/v3/projects/65c776a6268a401ba0894f44aef345b2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.565682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c776a6268a401ba0894f44aef345b2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:28.568529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:28.663884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c776a6268a401ba0894f44aef345b2', 'request_id': 'req-301968c8-43f4-4ee8-8889-dc3b94688406'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.671245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c776a6268a401ba0894f44aef345b2', 'request_id': 'req-301968c8-43f4-4ee8-8889-dc3b94688406'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.683283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c776a6268a401ba0894f44aef345b2', 'request_id': 'req-301968c8-43f4-4ee8-8889-dc3b94688406'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.696806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] The token cache is being invalidate because project 65c776a6268a401ba0894f44aef345b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:28.696806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.699985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-301968c8-43f4-4ee8-8889-dc3b94688406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:28.702102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1022/2002] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:28 2022] DELETE /identity/v3/projects/65c776a6268a401ba0894f44aef345b2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:28.707012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.707293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.707572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.745548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:28.746687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:28.905187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.905722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.905722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.906291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 981/2003] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:28.928137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:28.929543 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:28.943604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fceb15f-b06f-4969-8a81-fe6d2a9cbb3c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:28.948532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:28.949321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:28.949610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:28.949888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] PATH_INFO: `/v3/projects/301e65f716cd488fb43d8cddeba92f9e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:28.951253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=301e65f716cd488fb43d8cddeba92f9e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:28.953178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:28.973402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:28.974691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:29.000758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1023/2004] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:29.004938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.019056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811befb-b8f9-4459-b401-5c260a12ea35 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.024683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '301e65f716cd488fb43d8cddeba92f9e', 'request_id': 'req-6933d167-4f0a-4ff1-8235-a7d5b8576252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.034610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '301e65f716cd488fb43d8cddeba92f9e', 'request_id': 'req-6933d167-4f0a-4ff1-8235-a7d5b8576252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.044654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '301e65f716cd488fb43d8cddeba92f9e', 'request_id': 'req-6933d167-4f0a-4ff1-8235-a7d5b8576252'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.059746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] The token cache is being invalidate because project 301e65f716cd488fb43d8cddeba92f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:29.060203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.061276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.066426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 982/2005] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:28 2022] DELETE /identity/v3/projects/301e65f716cd488fb43d8cddeba92f9e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:29.068741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.070266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:29.118856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.119754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.120134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.120527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.121295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:29.121698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.123432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.153926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1024/2006] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:29.158100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.160378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:29.176088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd4f265-dd97-4056-92fe-7a73ddac9185 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.183395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.184623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.184917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.185382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.186236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.188835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.204441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:29.225282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933d167-4f0a-4ff1-8235-a7d5b8576252 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.231282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.231941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.232221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.232544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] PATH_INFO: `/v3/users/e749db415aad40e7af3e03a3a394a820` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.234674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e749db415aad40e7af3e03a3a394a820)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.237077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.240475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1025/2007] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:29 2022] POST /identity/v3/projects => generated 391 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:29.245193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.291178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:29.332995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89734fc2-3776-4059-8ea0-bf55ad7865ab admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.340181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.342085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.342474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.343588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.343588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.345801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.346360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e749db415aad40e7af3e03a3a394a820'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.347256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e749db415aad40e7af3e03a3a394a820'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.360784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e749db415aad40e7af3e03a3a394a820'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.370537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e749db415aad40e7af3e03a3a394a820'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.379424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1026/2008] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:29 2022] POST /identity/v3/users => generated 296 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:29.391711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.405395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde190e-c365-43a1-aebe-cd336e8fb41c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.411848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e749db415aad40e7af3e03a3a394a820'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:29.416628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.417496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.417675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.418310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.419054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.420729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 983/2009] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:29 2022] DELETE /identity/v3/users/e749db415aad40e7af3e03a3a394a820 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:29.424839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.438526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1027/2010] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:29.442808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.444361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:29.567843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d55c-22de-4efd-bda2-1ad4ae952ab3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.576647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.577277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.577649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.577931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.578585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.580452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4de8bc-4263-48fc-913b-f26ef954c4fb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.598042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 984/2011] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:29.602335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.613855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92dd5b-43a8-4fe9-b367-6d7a05123e35 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.621188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.622150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.622636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.622981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] PATH_INFO: `/v3/projects/8a7ff972d81146628e0cd6099b3dab9f/users/652f48ce42994ab38831c101bf36568d/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.655972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a7ff972d81146628e0cd6099b3dab9f, user_id=652f48ce42994ab38831c101bf36568d, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.661644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.701186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1028/2012] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:29 2022] PUT /identity/v3/projects/8a7ff972d81146628e0cd6099b3dab9f/users/652f48ce42994ab38831c101bf36568d/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:29.713877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.714267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.714677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.758929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] MFA Rules not processed for user `652f48ce42994ab38831c101bf36568d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:29.760692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:29.864088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 985/2013] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:29.869199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:29.951621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9011a5ba-a621-49fc-af8a-ba372bf4690a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:29.957030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:29.957747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:29.958145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:29.958573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:29.959286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:29.961420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:29.998578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.000936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.021308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1029/2014] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:29 2022] POST /identity/v3/projects => generated 393 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:30.024174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.053473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6ad503-b56b-4f39-bf82-5524fcf1b5f9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.085906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:30.105195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:30.156820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c3df3-65cd-4e33-9254-fd2abf030fa3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.162305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.162922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.163306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.163656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.164350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.167115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.167746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.168588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.169334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.169816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] PATH_INFO: `/v3/projects/9547c7a2610e4a12b4a112bfb1802419` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.171173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9547c7a2610e4a12b4a112bfb1802419)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.174248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.201212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1030/2015] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/users => generated 303 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:30.205389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.225886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7282da-146e-44fe-987b-284d9252f3d7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.239276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.239821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.240071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.240410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.242463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.244687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.253630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9547c7a2610e4a12b4a112bfb1802419', 'request_id': 'req-886db9a9-de71-45c1-9a7c-ca24ff4cf155'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:30.263696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9547c7a2610e4a12b4a112bfb1802419', 'request_id': 'req-886db9a9-de71-45c1-9a7c-ca24ff4cf155'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:30.264429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1031/2016] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:30.269527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.276108 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9547c7a2610e4a12b4a112bfb1802419', 'request_id': 'req-886db9a9-de71-45c1-9a7c-ca24ff4cf155'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:30.284113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ab67a-8178-4ccc-800d-7363593d8e3d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.291854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] The token cache is being invalidate because project 9547c7a2610e4a12b4a112bfb1802419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:30.292136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:30.293505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-886db9a9-de71-45c1-9a7c-ca24ff4cf155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:30.296144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 986/2017] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:29 2022] DELETE /identity/v3/projects/9547c7a2610e4a12b4a112bfb1802419 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:30.302846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5199b-d731-45d5-9e91-b9062a9da9bf None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.303037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5199b-d731-45d5-9e91-b9062a9da9bf None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.303294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5199b-d731-45d5-9e91-b9062a9da9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.349339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-64a5199b-d731-45d5-9e91-b9062a9da9bf None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:30.350614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-64a5199b-d731-45d5-9e91-b9062a9da9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.377533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.379727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.380282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.380892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] PATH_INFO: `/v3/projects/d5019b515a544f32b11559f956236222/users/86dc03f3666f4d1cbaabc5eab072c701/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.411032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5019b515a544f32b11559f956236222, user_id=86dc03f3666f4d1cbaabc5eab072c701, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.416126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.442925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1032/2018] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:30 2022] PUT /identity/v3/projects/d5019b515a544f32b11559f956236222/users/86dc03f3666f4d1cbaabc5eab072c701/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:30.443044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 987/2019] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:30.448383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.450944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.453764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.454051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.454328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.480132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:30.482006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.558839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:30.578316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2d84c1-2a55-44d2-931f-92fbc0e95f7d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.578746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 988/2020] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:30.583609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.595722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50dcae3-295f-4afd-9cc5-dffafc79f176 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.598802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.600853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.601127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.601626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.601751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.602072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.602593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.604742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.607828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.613518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.615588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:30.615911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.620152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.630113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1033/2021] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:30.631085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.642894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc6b9-0743-4740-98c0-ba97a7fc72fa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.647155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 989/2022] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:30.649145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.653364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.653946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.654265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.654506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] PATH_INFO: `/v3/projects/d5019b515a544f32b11559f956236222/users/86dc03f3666f4d1cbaabc5eab072c701/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.659906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5019b515a544f32b11559f956236222, user_id=86dc03f3666f4d1cbaabc5eab072c701, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.667622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41520ed8-af1a-4a5c-aa9a-c979b60d774c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.668378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f67991-b061-4966-809a-689d09450d01 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.674146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.674908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.676230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.676230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.676573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.679292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.695787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1034/2023] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:30 2022] PUT /identity/v3/projects/d5019b515a544f32b11559f956236222/users/86dc03f3666f4d1cbaabc5eab072c701/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:30.706647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.706943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.707260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.717093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 990/2024] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:30.722393 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.749893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] MFA Rules not processed for user `86dc03f3666f4d1cbaabc5eab072c701`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:30.751224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.758813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:30.819483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5477aaa-3215-4f0f-89cb-b0ba46e99443 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.825832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.826797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.827140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.827361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.828970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.831005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.882947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1035/2025] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:30.883744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.891132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 991/2026] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:30 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:30.893938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.895352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:30.897095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:30.935107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247ae26-d178-4c02-9327-ac2ed782b7a3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.941487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.942144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.942427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.942701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] PATH_INFO: `/v3/users/4f5cba49e44d4e65a0d358daa67c0ad3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:30.943872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f5cba49e44d4e65a0d358daa67c0ad3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:30.945834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:30.993186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632adfa-8ecf-42f7-aada-1f3f46407a4a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:30.998552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:30.999258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:30.999586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:30.999865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.024439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f5cba49e44d4e65a0d358daa67c0ad3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.032085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.032992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f5cba49e44d4e65a0d358daa67c0ad3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.033109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.042833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f5cba49e44d4e65a0d358daa67c0ad3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.043445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f5cba49e44d4e65a0d358daa67c0ad3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.052519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 992/2027] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:31.053760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.066038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6a2ff-639b-48f3-9086-e4735b6cf30f service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.071967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.072718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.073094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.073566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.074283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.076236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.083934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-878b23ab-1771-4620-b89e-78bd08d7d20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f5cba49e44d4e65a0d358daa67c0ad3'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.092320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 993/2028] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:31.096696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.097580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1036/2029] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:30 2022] DELETE /identity/v3/users/4f5cba49e44d4e65a0d358daa67c0ad3 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:31.099568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.105359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.105645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.106181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.120307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c00704-5ba3-4eb6-8b8e-814a2c3e12db admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.148882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:31.152644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.182452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:31.224308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.225160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.225444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.225719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.226551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.231595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.246403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 994/2030] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:31.252835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.258716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1037/2031] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:31.259888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.262919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.271949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e18997-5edc-4126-9a55-0a68af7c0fda None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.277237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.277845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.278122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.278397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] PATH_INFO: `/v3/projects/6960abba18204e27afc97f851ddd5413/users/e4677ee28ff84162befec0f1781c3555/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.293053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:31.298238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6960abba18204e27afc97f851ddd5413, user_id=e4677ee28ff84162befec0f1781c3555, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.302275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.321017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1038/2032] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:31 2022] PUT /identity/v3/projects/6960abba18204e27afc97f851ddd5413/users/e4677ee28ff84162befec0f1781c3555/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:31.322069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.334743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.355222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d21a6-086d-4792-8532-42be2db31db1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.416624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e3874-33f7-4ff0-b528-39520d6e028d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.419630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.420245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.420550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.420668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.420854 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.421149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.421866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.421866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.422672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.490159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.491611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a844f-8ed7-4bb1-be5d-d2be1e0f332f service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.498265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.499923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.501463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1039/2033] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:31.502845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.503132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.503406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.514151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 995/2034] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:31.515122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.516972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.522340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:31.523576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.532527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1040/2035] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:31.535952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1dc53e-f16a-4e4c-b863-3f566240dd90 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.541601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.542244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.542580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.542875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] PATH_INFO: `/v3/users/05ce372a1c5c40c3ae4c1889a77b78bc` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.544128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ce372a1c5c40c3ae4c1889a77b78bc)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.546871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.549087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.565109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0f21c-d912-446b-8964-7ca197d3b857 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:31.578357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:31.579112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.579522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.579839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.609413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:31.611108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3278e7-d3a6-4fdc-9d9e-d64d63912f15 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:31.629918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1041/2036] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:31.637501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:31.646714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ce372a1c5c40c3ae4c1889a77b78bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.647420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ce372a1c5c40c3ae4c1889a77b78bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.656692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ce372a1c5c40c3ae4c1889a77b78bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.668256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ce372a1c5c40c3ae4c1889a77b78bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.684464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ce372a1c5c40c3ae4c1889a77b78bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:31.695242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 996/2037] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:31 2022] DELETE /identity/v3/users/05ce372a1c5c40c3ae4c1889a77b78bc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:31.700024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:31.700571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:31.701046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:31.722568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:31.724183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:31.865411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1042/2038] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:31.933350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:31.937378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:32.112495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:32.114047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:32.117752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389b329-8059-44c6-9d1c-9d6327f9e28f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:32.124758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:32.125866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:32.126344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:32.126954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:32.130972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d2dfba-971b-44ee-85fa-5309322be99d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:32.136559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:32.137340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:32.137680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:32.138026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] PATH_INFO: `/v3/projects/7e07d32263114b268ea9c61a3cd50de7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:32.139786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e07d32263114b268ea9c61a3cd50de7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:32.141470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:32.143176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:32.145645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:32.161755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 997/2039] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:32.173424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:32.237676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e07d32263114b268ea9c61a3cd50de7', 'request_id': 'req-3fb90660-4736-4e3d-9a02-ca17f1b30810'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.246103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e07d32263114b268ea9c61a3cd50de7', 'request_id': 'req-3fb90660-4736-4e3d-9a02-ca17f1b30810'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.270192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e07d32263114b268ea9c61a3cd50de7', 'request_id': 'req-3fb90660-4736-4e3d-9a02-ca17f1b30810'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.286617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] The token cache is being invalidate because project 7e07d32263114b268ea9c61a3cd50de7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:32.287603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.288290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.292645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1043/2040] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:32 2022] DELETE /identity/v3/projects/7e07d32263114b268ea9c61a3cd50de7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:32.295380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:32.311215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353820e-9749-419d-a041-c2d427e70077 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:32.451146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:32.451823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:32.452105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:32.457821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] PATH_INFO: `/v3/users/8728ff4d2b9a40f19ff8c4a051a89561` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:32.460728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=8728ff4d2b9a40f19ff8c4a051a89561)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:32.469166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:32.667317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8728ff4d2b9a40f19ff8c4a051a89561'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.672378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8728ff4d2b9a40f19ff8c4a051a89561'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.711519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8728ff4d2b9a40f19ff8c4a051a89561'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.731614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8728ff4d2b9a40f19ff8c4a051a89561'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.733675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:32.800321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8728ff4d2b9a40f19ff8c4a051a89561'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:32.811858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 998/2041] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:32 2022] DELETE /identity/v3/users/8728ff4d2b9a40f19ff8c4a051a89561 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:32.877570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:32.884215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:32.902373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90660-4736-4e3d-9a02-ca17f1b30810 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:32.969573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:32.970387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:32.970952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:32.971241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] PATH_INFO: `/v3/projects/a5653126da0d407e892dacd0bd20a202` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:32.972430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5653126da0d407e892dacd0bd20a202)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:32.974527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:33.050000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5653126da0d407e892dacd0bd20a202', 'request_id': 'req-0c4e2092-1026-487b-a930-026f30c02235'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.057164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5653126da0d407e892dacd0bd20a202', 'request_id': 'req-0c4e2092-1026-487b-a930-026f30c02235'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.066341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5653126da0d407e892dacd0bd20a202', 'request_id': 'req-0c4e2092-1026-487b-a930-026f30c02235'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.079964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] The token cache is being invalidate because project a5653126da0d407e892dacd0bd20a202 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:33.080257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.081033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-0c4e2092-1026-487b-a930-026f30c02235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.083635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1044/2042] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:32 2022] DELETE /identity/v3/projects/a5653126da0d407e892dacd0bd20a202 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:33.086894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:33.088929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:33.103784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76bbe3-c537-48ea-91da-d0924e987fed admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:33.186979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:33.187675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:33.188036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:33.188213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] PATH_INFO: `/v3/users/09ff8f6742f14afda331538a50fefa37` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:33.190034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09ff8f6742f14afda331538a50fefa37)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:33.192006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:33.255734 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09ff8f6742f14afda331538a50fefa37'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.256437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09ff8f6742f14afda331538a50fefa37'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.269641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09ff8f6742f14afda331538a50fefa37'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.279418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09ff8f6742f14afda331538a50fefa37'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.302610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09ff8f6742f14afda331538a50fefa37'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.324340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 999/2043] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:33 2022] DELETE /identity/v3/users/09ff8f6742f14afda331538a50fefa37 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:33.344860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:33.345337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:33.345415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:33.411950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] MFA Rules not processed for user `e4677ee28ff84162befec0f1781c3555`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:33.413116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:33.462114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:33.568430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1045/2044] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:33.571985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:33.573537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:33.657575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:33.659258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:33.669608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb5440-bc62-441f-b78c-107411d46f67 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:33.676651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:33.677863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:33.678481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:33.680414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:33.684378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:33.689443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:33.694018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5d632-b6f7-4774-a339-e64dd60aae52 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:33.697040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:33.706520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:33.707533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:33.707890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:33.708459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] PATH_INFO: `/v3/projects/9860e7178a3e47aa9393f5fdb3712d68` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:33.711125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9860e7178a3e47aa9393f5fdb3712d68)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:33.718650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:33.760423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1000/2045] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:33 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:33.762993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:33.807714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9860e7178a3e47aa9393f5fdb3712d68', 'request_id': 'req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.815595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9860e7178a3e47aa9393f5fdb3712d68', 'request_id': 'req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.833060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9860e7178a3e47aa9393f5fdb3712d68', 'request_id': 'req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.860672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] The token cache is being invalidate because project 9860e7178a3e47aa9393f5fdb3712d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:33.864010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.867783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2126b4d0-4d5d-4eff-bb23-7a9ff4b7c463 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:33.875349 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1046/2046] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:33 2022] DELETE /identity/v3/projects/9860e7178a3e47aa9393f5fdb3712d68 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:33.875524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b568b91-106a-428f-b96a-cc93505644d4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:33.879269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:33.879649 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:33.880143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:33.934458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:33.936088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.028599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.030537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.030537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.030537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.030537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.048457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ae76ab-7d20-4a5b-a28d-5baf4d7c1d3c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.113645 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1001/2047] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:33 2022] POST /identity/v3/users => generated 292 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:34.113824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1047/2048] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:34.120805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.121530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.123072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.124519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.127112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.142800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aa586-441e-4d14-87e9-adb140cdb4c4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.150942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.151620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.151906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.152674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.153378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.155627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.172680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1048/2049] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:34.172680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.175508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:34.176897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.177170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.187487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1002/2050] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:34.189383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.197928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70840e09-892b-40ae-8940-7d8b4ebd6036 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.203539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.204185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.204573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.204930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] PATH_INFO: `/v3/projects/cacc1c9f04524e50a3c4f5e873213b69` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.205480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39eb094-cdca-4a75-99b5-4b8fec7c1b9a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.205965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cacc1c9f04524e50a3c4f5e873213b69)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.208104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.215009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.216411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.216916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.217386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] PATH_INFO: `/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6/users/abb56d732ed84776b0eb8c8965b03537/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.249545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=896d1ea8dfc345d59fe19ce858b0f6d6, user_id=abb56d732ed84776b0eb8c8965b03537, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.253441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.265103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:34.278506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1003/2051] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:34 2022] PUT /identity/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6/users/abb56d732ed84776b0eb8c8965b03537/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:34.281324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.289820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cacc1c9f04524e50a3c4f5e873213b69', 'request_id': 'req-954f895e-96a1-4f05-be6b-ac79d0f12370'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:34.298263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cacc1c9f04524e50a3c4f5e873213b69', 'request_id': 'req-954f895e-96a1-4f05-be6b-ac79d0f12370'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:34.312086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cacc1c9f04524e50a3c4f5e873213b69', 'request_id': 'req-954f895e-96a1-4f05-be6b-ac79d0f12370'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:34.343685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] The token cache is being invalidate because project cacc1c9f04524e50a3c4f5e873213b69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:34.343685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:34.345265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:34.347384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1049/2052] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:34 2022] DELETE /identity/v3/projects/cacc1c9f04524e50a3c4f5e873213b69 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:34.348427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.349961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.375414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:34.398201 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15abbd66-57ec-41a7-9485-3f4c3b69d263 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.410991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.411735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.412124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.412638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.413361 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:34.413843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.416300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41699954-03d6-4a9a-a91c-031afb83ab7b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.435327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1004/2053] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:34.436778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.437060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.437474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.438363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f895e-96a1-4f05-be6b-ac79d0f12370 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.443476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.444297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.444765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.445081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.446002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.449059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.460224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:34.461277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1050/2054] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:34.463034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.464886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.465482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.474896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1005/2055] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:34.477419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.479694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab3b9f-f03f-41f2-ac69-88c99187fdd2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.485828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.485828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.486091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.486292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.486915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.488927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9538b709-272a-4e26-8130-bce102fd9697 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.509567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eed258-fb8c-4fbc-8138-99fcac19b7e3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.522821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1051/2056] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:34.524191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.525048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.525330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.527245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.528180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.528821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.529407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] PATH_INFO: `/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6/users/abb56d732ed84776b0eb8c8965b03537/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.532206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] RBAC: Authorizing `identity:create_grant(project_id=896d1ea8dfc345d59fe19ce858b0f6d6, user_id=abb56d732ed84776b0eb8c8965b03537, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.535172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.550107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1006/2057] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:34 2022] PUT /identity/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6/users/abb56d732ed84776b0eb8c8965b03537/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:34.550955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.570820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:34.573282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.647455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e485ed-2079-4a42-b3ab-f8fe01dcf5af admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.657375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.659135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.659418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.659690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.660950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.664128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.666190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1052/2058] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:34.672137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.683584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ed692-d6cd-475e-81f4-2e6898c2c509 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.693759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.694510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.694987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.695286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.696059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:34.696633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.698415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1007/2059] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:34.700029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.702804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.718074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c411a-091d-41d7-a55e-a6770d0234b1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.720732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1053/2060] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:34.726818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.727679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.729121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.729612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.730082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.731404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.733281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.741697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc96781d-f55a-4cd3-bc45-3c5ad6a75aa5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.750010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1008/2061] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:34.754833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.766238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.767198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.769376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.769851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.770723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.771871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddf6d-7069-404e-a141-4c6f8c3121bc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.774260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.778938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.785612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.786113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.786396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.787356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.789064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.808548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1009/2062] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:34.812699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.817070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:34.824808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd5713-9dfa-4415-90e3-8a3af53c4b39 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.828894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1054/2063] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/projects => generated 359 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:34.830358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.893921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.894871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.896016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.896669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] PATH_INFO: `/v3/projects/2874e1c105be4e12b889c196b94de5e7/users/820c45d5c88f473fa3fa0616ac0c6baf/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.919014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2874e1c105be4e12b889c196b94de5e7, user_id=820c45d5c88f473fa3fa0616ac0c6baf, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.920268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697d6c8-ca54-4692-8d94-dbcfcb4a457b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.922372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793a174-efec-4bdb-8ef9-2ce8d2a8977e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.926722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:34.927600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.927969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.928458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.929342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:34.932360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:34.940461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1010/2064] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:34 2022] PUT /identity/v3/projects/2874e1c105be4e12b889c196b94de5e7/users/820c45d5c88f473fa3fa0616ac0c6baf/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:34.952068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:34.952444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:34.952714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:34.963314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1055/2065] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/users => generated 280 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:34.967860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:34.980572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b66701-36a7-49ef-9d33-4fea988aa62f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:34.986486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] MFA Rules not processed for user `820c45d5c88f473fa3fa0616ac0c6baf`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:34.987843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:34.992008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:35.093976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.094974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.095540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.096016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.096937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.099852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.110615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1011/2066] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:35.116119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.124433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1056/2067] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:34 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:35.128067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.130979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e83aa93-b6f5-4bac-9195-1826bc6e8c59 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.137399 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.138102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.138385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.138659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.139892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.141407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92238e0-4051-4185-92e3-632e9ef675ba admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.142319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.151355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.152043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.153206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.153494 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.154202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.155881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.173256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1057/2068] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:35.174706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.185625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1012/2069] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/projects => generated 377 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:35.189495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.194613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b5d91-7e6c-4bee-8e75-00e7fc4a0a0a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.267396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.268155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.268467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.268995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] PATH_INFO: `/v3/projects/63fcaf7b9868457b8184d28f87ebc505/users/111cb604d78246ddb02849d7bc44592b/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.280244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f9c40-28a3-46ed-83d6-16c7d3b98b51 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.285157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.285860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.286144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.286418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.286983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fcaf7b9868457b8184d28f87ebc505, user_id=111cb604d78246ddb02849d7bc44592b, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.287229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.290248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c64bf4-8fd3-49b7-93dc-db3d2918dd96 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.291257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.296111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:35.311742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1058/2070] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:35 2022] PUT /identity/v3/projects/63fcaf7b9868457b8184d28f87ebc505/users/111cb604d78246ddb02849d7bc44592b/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:35.316557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1013/2071] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:35.319034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.322807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6dd8-b645-4eba-b8fa-c5c1a7f70178 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.322995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6dd8-b645-4eba-b8fa-c5c1a7f70178 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.323246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6dd8-b645-4eba-b8fa-c5c1a7f70178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.359226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ebff6dd8-b645-4eba-b8fa-c5c1a7f70178 None None] MFA Rules not processed for user `111cb604d78246ddb02849d7bc44592b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:35.360574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ebff6dd8-b645-4eba-b8fa-c5c1a7f70178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.421139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8b5d0-5ae4-4d11-9735-000b26c22142 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.425926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.426885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.427230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.427839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.428647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.434720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1014/2072] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:35.434954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.435096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.435096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.435096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.448070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:35.456280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1059/2073] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:35.456280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.472507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029addfb-5bac-43cd-b661-38f77747f020 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.477604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.478474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.478852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.479222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.479938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.481016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] MFA Rules not processed for user `abb56d732ed84776b0eb8c8965b03537`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:35.482001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.482369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.494179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1060/2074] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:35.494904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.498120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.560871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16c6a0-b7f6-4098-9534-588656732547 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.566679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.567696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.567696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.567868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.573195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1015/2075] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:35.574707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.578409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.579835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8762942-b2a0-43ad-ba8e-dae6aa30309b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.590961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1061/2076] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:35.592239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ccb9-49cd-409d-a9ad-1a98dedae001 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.592687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ccb9-49cd-409d-a9ad-1a98dedae001 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.593031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd2ccb9-49cd-409d-a9ad-1a98dedae001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.613527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a06b6e-e193-43b4-b2f7-d96505c879fb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.620242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.621059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.621232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.621526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] PATH_INFO: `/v3/projects/d5b63cb66db94b978ae20c34aa92e830/users/ff0a50c735df43e684063adcafd32192/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.629846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4fd2ccb9-49cd-409d-a9ad-1a98dedae001 None None] MFA Rules not processed for user `e4677ee28ff84162befec0f1781c3555`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:35.631092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4fd2ccb9-49cd-409d-a9ad-1a98dedae001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.660995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b63cb66db94b978ae20c34aa92e830, user_id=ff0a50c735df43e684063adcafd32192, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.670479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.711259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1016/2077] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:35 2022] PUT /identity/v3/projects/d5b63cb66db94b978ae20c34aa92e830/users/ff0a50c735df43e684063adcafd32192/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:35.711259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.740465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1062/2078] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:35.740465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.740465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.740465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.769686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] MFA Rules not processed for user `ff0a50c735df43e684063adcafd32192`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:35.770934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.791719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:35.809818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930d57e-bd86-4e65-a7dd-adae96663772 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.823331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:35.824582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:35.825112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:35.825594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] PATH_INFO: `/v3/users/111cb604d78246ddb02849d7bc44592b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:35.827251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111cb604d78246ddb02849d7bc44592b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:35.830218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:35.872513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1063/2079] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:35.872513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.872513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.887519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111cb604d78246ddb02849d7bc44592b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:35.888209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111cb604d78246ddb02849d7bc44592b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:35.897005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111cb604d78246ddb02849d7bc44592b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:35.904732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111cb604d78246ddb02849d7bc44592b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:35.907065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:35.919294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111cb604d78246ddb02849d7bc44592b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:35.925314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1017/2080] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:35 2022] DELETE /identity/v3/users/111cb604d78246ddb02849d7bc44592b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:35.926252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:35.927575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:35.947666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cea1d9d-5bd4-452a-bc29-ba386eee056b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:35.995717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0710a717-35c0-4f29-b35e-94b97fefaab7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.000483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.001080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.001362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.001631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.002252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.004162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.011360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.011973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.012254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.012562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.014433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.035455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1018/2081] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:35 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:36.035455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.035455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.073814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:36.077457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.079559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0576dcbc-f234-4f57-bb4f-c700222fb27a service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.090032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1064/2082] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:36.091408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.091701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.091979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.100096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b94b6c-83d4-4783-8f02-cbec7b3b69ec admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.106363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.107011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.107291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.107568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] PATH_INFO: `/v3/users/652f48ce42994ab38831c101bf36568d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.108786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] RBAC: Authorizing `identity:delete_user(user_id=652f48ce42994ab38831c101bf36568d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.110719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.113862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:36.115096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.127517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1065/2083] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:36.127517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.138304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5817ac-478a-4ea5-8111-b1b53c3cf6ab None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.143689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.144220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.144732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.144943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.145592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.147508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.170248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '652f48ce42994ab38831c101bf36568d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:36.171009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '652f48ce42994ab38831c101bf36568d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:36.174635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1066/2084] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:36 2022] POST /identity/v3/users => generated 296 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:36.174635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.176285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.179560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '652f48ce42994ab38831c101bf36568d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:36.187489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '652f48ce42994ab38831c101bf36568d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:36.193487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:36.202833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '652f48ce42994ab38831c101bf36568d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:36.212555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1019/2085] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:36 2022] DELETE /identity/v3/users/652f48ce42994ab38831c101bf36568d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:36.213380 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.214740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.253590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138ccc2-f330-481c-ac05-4141379f6131 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.303439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ff69e-67a7-42e3-885f-62bfe395d52d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.311437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.312926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.313697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.314324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.316700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.319184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd706b-1d92-4409-af4c-2ac2fa99416a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.324964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.326285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.326840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.327124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.329291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.333226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1020/2086] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:36.335128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.335629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.336246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.348517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.350305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.361541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:36.363377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.364966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1067/2087] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:36.365653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.374197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1021/2088] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:36.379100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74b6ff-3f08-4189-95a3-0823d5b41db1 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.388601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.390537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.390695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.391544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.391949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.392236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] PATH_INFO: `/v3/projects/cb53ef8de8fc45acac150a49939a3e46/users/d8dbf48067844e5dad9f60aa926548e9/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.409129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b140d2-bff7-490f-ab5c-dcc3f7cca1c1 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.411884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb53ef8de8fc45acac150a49939a3e46, user_id=d8dbf48067844e5dad9f60aa926548e9, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.412908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.413523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.413801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.414075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.414832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.425779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.427338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.438552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1068/2089] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:36 2022] PUT /identity/v3/projects/cb53ef8de8fc45acac150a49939a3e46/users/d8dbf48067844e5dad9f60aa926548e9/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:36.439066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1022/2090] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:36.441400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.519743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4ff5d-4276-4c0e-a765-fcbe28698b86 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.525490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.526103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.526382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.527043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.527343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.529033 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8835be-c6ee-4380-99db-dfe76dfc7feb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.537105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:36.549715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1069/2091] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:36.551940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.562866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1b857-c368-45d4-9e02-1349984b4505 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.567903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.568700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.569050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.569535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] PATH_INFO: `/v3/projects/cb53ef8de8fc45acac150a49939a3e46/users/d8dbf48067844e5dad9f60aa926548e9/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.572499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb53ef8de8fc45acac150a49939a3e46, user_id=d8dbf48067844e5dad9f60aa926548e9, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.575627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.589592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1023/2092] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:36 2022] PUT /identity/v3/projects/cb53ef8de8fc45acac150a49939a3e46/users/d8dbf48067844e5dad9f60aa926548e9/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:36.601342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.601920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.603070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.643940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] MFA Rules not processed for user `d8dbf48067844e5dad9f60aa926548e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:36.645465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.757196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1070/2093] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:36.772833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.774839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.899791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287c502-9621-4f1d-bc70-b0c7d9e18a96 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:36.903696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.906817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:36.914801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:36.917034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:36.917364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:36.917694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:36.936756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:36.938805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:36.953997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1024/2094] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:36.972918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:36.975722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.073446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:37.089330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3fdf9d-6d81-46f0-837f-28cd3fe5be9b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.094819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1a301-6349-40b3-aa57-2d90c3b1039d service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.101173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.103291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.104114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.104987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.105513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.105965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] PATH_INFO: `/v3/projects/63fcaf7b9868457b8184d28f87ebc505` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.106771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.107131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] PATH_INFO: `/v3/projects/8a7ff972d81146628e0cd6099b3dab9f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.108166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a7ff972d81146628e0cd6099b3dab9f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.109097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fcaf7b9868457b8184d28f87ebc505)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.110985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.114835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.169492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a7ff972d81146628e0cd6099b3dab9f', 'request_id': 'req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.175689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a7ff972d81146628e0cd6099b3dab9f', 'request_id': 'req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.180436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fcaf7b9868457b8184d28f87ebc505', 'request_id': 'req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.185452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a7ff972d81146628e0cd6099b3dab9f', 'request_id': 'req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.190165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fcaf7b9868457b8184d28f87ebc505', 'request_id': 'req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.200555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] The token cache is being invalidate because project 8a7ff972d81146628e0cd6099b3dab9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:37.200901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.201661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.202997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fcaf7b9868457b8184d28f87ebc505', 'request_id': 'req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.203772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1071/2095] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:36 2022] DELETE /identity/v3/projects/8a7ff972d81146628e0cd6099b3dab9f => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:37.204665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.206030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.220033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] The token cache is being invalidate because project 63fcaf7b9868457b8184d28f87ebc505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:37.220232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.220965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.226198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1025/2096] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:36 2022] DELETE /identity/v3/projects/63fcaf7b9868457b8184d28f87ebc505 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:37.226198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.226198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.232600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:37.284383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f890aac-a34b-4ce5-a753-f6c6fc8e80d8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.317843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4f602-ae5f-4f40-b8fa-b7e9eb803684 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.323682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.324488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.324839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.325211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] PATH_INFO: `/v3/users/86dc03f3666f4d1cbaabc5eab072c701` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.326925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86dc03f3666f4d1cbaabc5eab072c701)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.342148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.357682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.358438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.358818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.358986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.361159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.404677 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86dc03f3666f4d1cbaabc5eab072c701'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.405551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86dc03f3666f4d1cbaabc5eab072c701'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.416774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86dc03f3666f4d1cbaabc5eab072c701'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.426544 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86dc03f3666f4d1cbaabc5eab072c701'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.441728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.443271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77322906-2ea4-47a7-8793-4448e703ce48 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.443846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c24bf711-2f7f-41bd-b9fd-97a2c1755dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86dc03f3666f4d1cbaabc5eab072c701'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:37.453779 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1072/2097] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:37.454964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.455257 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.455532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.459629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1026/2098] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:37 2022] DELETE /identity/v3/users/86dc03f3666f4d1cbaabc5eab072c701 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:37.483276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:37.484219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.594678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1073/2099] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:37.604020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.604309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.605045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.616964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:37.642891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:37.645465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.661414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1027/2100] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:37.665940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.677157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c168-3387-4fae-a4e2-f798a0d18663 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.683415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.683415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.683667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.683880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.684720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:37.684893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.686624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.701023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1074/2101] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:37.705404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.718257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35c592-78b4-4dc7-b095-86f0394fc8f5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.723851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.725029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.725569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.726068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.726955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.729412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.791815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.793018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1028/2102] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:37 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:37.804666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395f317-f513-4cde-b896-4eb0b3bc045b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.821956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:37.906303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:37.907099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:37.907386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:37.907778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:37.908500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:37.910775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:37.950264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1075/2103] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:37 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:37.950595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.964976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:37.969842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:37.986778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4adcf-0cff-4839-8966-9b7fbe0f3484 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:37.999918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.000685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.001655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.001655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.002291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.005230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.016877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41e58f3-0f57-4848-bfa2-2f98d7ea1ad7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.019817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1029/2104] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:37 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:38.024754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.037073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.037730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.038015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.038351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] PATH_INFO: `/v3/projects/d5019b515a544f32b11559f956236222` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.040676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5019b515a544f32b11559f956236222)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.044158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.049124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942334d-acb4-4ef2-b35b-60f65ef6ba04 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.082540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.083180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.083465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.083743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.084445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.086127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.098872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1030/2105] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:38.103943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.117897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2b944-fec3-4f36-b435-6cf932c8f576 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.125624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5019b515a544f32b11559f956236222', 'request_id': 'req-9a2251f2-5b90-4882-9ab2-6bd11be61360'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:38.132059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5019b515a544f32b11559f956236222', 'request_id': 'req-9a2251f2-5b90-4882-9ab2-6bd11be61360'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:38.147346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5019b515a544f32b11559f956236222', 'request_id': 'req-9a2251f2-5b90-4882-9ab2-6bd11be61360'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:38.165839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] The token cache is being invalidate because project d5019b515a544f32b11559f956236222 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:38.166208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:38.167486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9a2251f2-5b90-4882-9ab2-6bd11be61360 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:38.172651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1076/2106] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:37 2022] DELETE /identity/v3/projects/d5019b515a544f32b11559f956236222 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:38.174415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d18b4-59c6-41d9-96e4-98578397fa7e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.174701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d18b4-59c6-41d9-96e4-98578397fa7e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.174977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d18b4-59c6-41d9-96e4-98578397fa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.189238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.190101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.190422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.190841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] PATH_INFO: `/v3/projects/63c61bb7d0ce4ace8470cd323b3aa7ea/users/77a345d8009541bd9d47e7990140a500/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.197046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bd6d18b4-59c6-41d9-96e4-98578397fa7e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:38.198917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bd6d18b4-59c6-41d9-96e4-98578397fa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:38.207298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c61bb7d0ce4ace8470cd323b3aa7ea, user_id=77a345d8009541bd9d47e7990140a500, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.210261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13066aa4-917c-42dc-9246-d944dc12f724 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.214901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1077/2107] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:38.216659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.216974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.217318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.228704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1031/2108] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:38 2022] PUT /identity/v3/projects/63c61bb7d0ce4ace8470cd323b3aa7ea/users/77a345d8009541bd9d47e7990140a500/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:38.238754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:38.239104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.239396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.239678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.239982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:38.271809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] MFA Rules not processed for user `77a345d8009541bd9d47e7990140a500`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:38.273188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:38.322823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1078/2109] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:38.327841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.340151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435fa99-074f-40a5-a011-1d719be89996 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.357011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.358148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.358425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.358983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.359356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:38.362219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1032/2110] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:38.362363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.364886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.367574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.370166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:38.396288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501067d-f4a5-4bc3-9542-0b299efba27d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.410555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1079/2111] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:57:38.411534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.412592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.413229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.413508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.413782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.414412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.416422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.432353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c5264e-cad9-4062-91f4-569d84aacf5a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.445461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.446734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.447103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.447383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.448019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.453361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.461766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:38.481591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1033/2112] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:38.485913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.491684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:38.528455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1080/2113] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/projects => generated 409 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:38.530815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.627255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc9c7f-dc08-4eda-8996-e16cbd9da1cb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.644378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db17de-57cc-4ce4-9f37-9ed93512ab63 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.658772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.672869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.672869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.672869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.672869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.672869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.708874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1081/2114] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:38.714815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.741213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7f2794-e000-44bc-9db5-ecaff4bf4356 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.757920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41049401-135f-4652-afb4-82e721068816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.758880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049401-135f-4652-afb4-82e721068816 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.759227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049401-135f-4652-afb4-82e721068816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.760206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41049401-135f-4652-afb4-82e721068816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.760453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41049401-135f-4652-afb4-82e721068816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.762563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41049401-135f-4652-afb4-82e721068816 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.770889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.771694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.771816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.772037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.778392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.782215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.788367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1082/2115] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:38.790805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41049401-135f-4652-afb4-82e721068816 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.804251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41049401-135f-4652-afb4-82e721068816 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.813269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.814181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.814668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.815115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.816112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.818347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.819391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1034/2116] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:38.823236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.838575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c953afc-6759-472f-9427-482a4b73cfd5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.844533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1083/2117] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:38.848837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.852014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.853384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.853822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.854266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.855067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.857290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.864121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5624507a-6d6f-4c1f-8530-686c948a7c29 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.870195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.870958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.871329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.871854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] PATH_INFO: `/v3/projects/d8dc0bfce3ee49bfb20edd4da2b40607/users/520b3d7c1dfa42efb18cd661f9a85401/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.877931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1035/2118] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:38.879695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:38.891228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8dc0bfce3ee49bfb20edd4da2b40607, user_id=520b3d7c1dfa42efb18cd661f9a85401, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.894569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed41a00-26f1-4c05-857c-e1fd439e275c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.903394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49aef9-08b7-4567-b525-679887b0e4ae admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:38.916421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1084/2119] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:38 2022] PUT /identity/v3/projects/d8dc0bfce3ee49bfb20edd4da2b40607/users/520b3d7c1dfa42efb18cd661f9a85401/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:38.923436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.923767 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.924048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.959032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] MFA Rules not processed for user `520b3d7c1dfa42efb18cd661f9a85401`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:38.960634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:38.982864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:38.983685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:38.983970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:38.984357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:38.985042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:38.987865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:38.999303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1036/2120] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:39.003081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.014491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779b2f-6ef4-4ae8-9518-663b75256d8f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.020111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.020800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.021080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.021359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] PATH_INFO: `/v3/projects/c9f1ec188b504422a247163ba6ae0e2e/users/13642cb98d2c4b5292282d374235fffb/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.038536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1085/2121] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:39.043492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.047669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9f1ec188b504422a247163ba6ae0e2e, user_id=13642cb98d2c4b5292282d374235fffb, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.051465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f89ac6e-d328-4eb0-b74e-af75b194a3d6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.061467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5009-093b-48fb-858d-812a1a5d44b4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.068522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.069281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.069569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.069867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.070660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.072792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.074324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:39.085485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1037/2122] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:39 2022] PUT /identity/v3/projects/c9f1ec188b504422a247163ba6ae0e2e/users/13642cb98d2c4b5292282d374235fffb/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:39.097059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.097351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.097881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.100637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:39.121017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1086/2123] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/projects => generated 409 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:39.122584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.151766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] MFA Rules not processed for user `13642cb98d2c4b5292282d374235fffb`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:39.153244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:39.221686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d0470d-6031-4e87-a6d0-00b961261171 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.227110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.228671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.228671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.229044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.229554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.231881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.255554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1038/2124] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:39.262163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.266673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1087/2125] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/users => generated 311 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:39.271059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.276423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89161b12-dbc7-4c1c-a211-ca96ee22f4e9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.285652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.286423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.286928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.287307 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.288350 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.291974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.294542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e7dee-28a8-4388-bdf3-f0a0f89491bf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.308710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.309325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.309601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.309870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.310513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.312103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.324604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1088/2126] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:39.329581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.347595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad575fb-5e46-47d3-a30c-3aa812b037e0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.353889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1039/2127] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:39.357445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.463484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.464893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.465325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.465776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] PATH_INFO: `/v3/projects/e553df9b4b604b38a6def4fb884c96fb/users/e2144e7be96744a2a09255054aaacdeb/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.500668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e553df9b4b604b38a6def4fb884c96fb, user_id=e2144e7be96744a2a09255054aaacdeb, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.503990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.533047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f24fd1-89fa-4885-aceb-b71eaed80eed admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.535256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1089/2128] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:39 2022] PUT /identity/v3/projects/e553df9b4b604b38a6def4fb884c96fb/users/e2144e7be96744a2a09255054aaacdeb/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:39.540534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.603704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.604320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.604627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.604903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.605903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.608754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.626090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:39.632178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb8eb-5b1d-41e5-b993-ef4fa168c697 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.636235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1040/2129] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:39.642213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.642432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.642557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.642890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.643235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.645826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.651501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.653328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:39.659292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d9532b-40cf-4c60-9f6e-1505794ee4c9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.668327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.669176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.669638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.669915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.670745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.672360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.674637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1090/2130] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:39.676226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.693196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1041/2131] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:39.697732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.701020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9620a0-e5c3-41f2-bc32-cdc43bb5b29b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.707945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.709059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.709662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.709774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ae70-a375-4350-9eb5-37a072035e23 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.710168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] PATH_INFO: `/v3/projects/e553df9b4b604b38a6def4fb884c96fb/users/e2144e7be96744a2a09255054aaacdeb/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.713244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e553df9b4b604b38a6def4fb884c96fb, user_id=e2144e7be96744a2a09255054aaacdeb, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.715620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.715905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8db2347-be5f-4d13-8b35-30c36951fc7b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.716564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.716848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.717217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] PATH_INFO: `/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f/users/773917426e8a43b2bf729db0c8533e7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.733988 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1091/2132] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:39 2022] PUT /identity/v3/projects/e553df9b4b604b38a6def4fb884c96fb/users/e2144e7be96744a2a09255054aaacdeb/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:39.742650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3d87214aaf4a35a3670cc7b35a826f, user_id=773917426e8a43b2bf729db0c8533e7f, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.742650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.747758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.748046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.748348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.757152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1042/2133] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:39 2022] PUT /identity/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f/users/773917426e8a43b2bf729db0c8533e7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:39.761669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.786497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] MFA Rules not processed for user `e2144e7be96744a2a09255054aaacdeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:39.787658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:39.834263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25067b-6be9-4bf3-a41b-a4d1397d7792 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.839255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.840031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.840370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.840683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.841339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.842960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.853887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1043/2134] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:39.858213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.869154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db386761-2f20-4352-8c3a-6e9fda954993 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:39.874518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:39.875177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.875505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.875787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] PATH_INFO: `/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f/users/773917426e8a43b2bf729db0c8533e7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.879310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1092/2135] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:39.886199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d3d87214aaf4a35a3670cc7b35a826f, user_id=773917426e8a43b2bf729db0c8533e7f, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:39.886775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:39.888170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:39.889124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d54c0-2d2a-4f7c-955f-bbbc923fc277 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:39.902106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1044/2136] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:39 2022] PUT /identity/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f/users/773917426e8a43b2bf729db0c8533e7f/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:39.912292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:39.912837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:39.913095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:39.957082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] MFA Rules not processed for user `773917426e8a43b2bf729db0c8533e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:39.957739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:39.984043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60b8e3-4f08-4c91-b820-29facf0a67e0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:40.046522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:40.046522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:40.046773 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:40.047021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:40.068976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1045/2137] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:40.090775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:40.093113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:40.113592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:40.119339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c93df-6fae-4074-97ad-a36b8769d665 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:40.130672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:40.132003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:40.133087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:40.134117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:40.168657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:40.170125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:40.184231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1093/2138] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:40.204235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:40.246571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:40.246571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:40.267925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1046/2139] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:40.471451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:40.481527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e9658-8f2a-484d-87c3-9915af92471a service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:40.485486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:40.486105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:40.486388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:40.486665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:40.582323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:40.583877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c1526-759f-47d3-8d5e-20f981385964 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:40.605044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1094/2140] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:40.873179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:40.875050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:40.980972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957c0da-39d8-4d8f-b142-6f572b63f08e service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:40.985704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:40.986339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:40.986617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:40.986892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] PATH_INFO: `/v3/users/820c45d5c88f473fa3fa0616ac0c6baf` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:40.988051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=820c45d5c88f473fa3fa0616ac0c6baf)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:40.990097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:41.108016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820c45d5c88f473fa3fa0616ac0c6baf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.108867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820c45d5c88f473fa3fa0616ac0c6baf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.122539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820c45d5c88f473fa3fa0616ac0c6baf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.132175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820c45d5c88f473fa3fa0616ac0c6baf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.148968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820c45d5c88f473fa3fa0616ac0c6baf'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.162366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1047/2141] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:40 2022] DELETE /identity/v3/users/820c45d5c88f473fa3fa0616ac0c6baf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:41.164263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:41.165421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:41.165919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:41.206738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:41.209283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:41.304829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1095/2142] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:41.312436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:41.314571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:41.398726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a64ec8-b22e-4cc1-ab35-f1aa940b9386 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:41.402864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:41.403485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:41.403795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:41.404072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:41.414955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:41.416639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:41.421412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:41.431250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1048/2143] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:41.852051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:41.855287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:41.872057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d90eca-0d71-4173-b3db-93c78b0298d2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:41.878909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:41.879814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:41.880253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:41.881477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] PATH_INFO: `/v3/projects/2874e1c105be4e12b889c196b94de5e7` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:41.883038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2874e1c105be4e12b889c196b94de5e7)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:41.898039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:41.976755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2874e1c105be4e12b889c196b94de5e7', 'request_id': 'req-d962c52a-71e0-479f-a80b-700c856d87d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:41.986685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2874e1c105be4e12b889c196b94de5e7', 'request_id': 'req-d962c52a-71e0-479f-a80b-700c856d87d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.005192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:42.006653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:42.017775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2874e1c105be4e12b889c196b94de5e7', 'request_id': 'req-d962c52a-71e0-479f-a80b-700c856d87d2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.019264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:42.050205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] The token cache is being invalidate because project 2874e1c105be4e12b889c196b94de5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:42.050577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.051208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.053080 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1096/2144] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:41 2022] DELETE /identity/v3/projects/2874e1c105be4e12b889c196b94de5e7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:42.057243 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:42.059246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:42.128372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdaba6e-5ca6-48ad-8d4b-da33e3207dcf service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:42.203747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d962c52a-71e0-479f-a80b-700c856d87d2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:42.210055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:42.210055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:42.210055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:42.210468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] PATH_INFO: `/v3/users/ff0a50c735df43e684063adcafd32192` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:42.212962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0a50c735df43e684063adcafd32192)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:42.216260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:42.274451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:42.275129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:42.275601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:42.276132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:42.279947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:42.326388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0a50c735df43e684063adcafd32192'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.342867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0a50c735df43e684063adcafd32192'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.354393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0a50c735df43e684063adcafd32192'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.356898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0a50c735df43e684063adcafd32192'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.382275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0a50c735df43e684063adcafd32192'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:42.406003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1097/2145] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:42 2022] DELETE /identity/v3/users/ff0a50c735df43e684063adcafd32192 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:42.461710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:42.463193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:42.490759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1049/2146] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:43.054095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:43.057120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:43.197422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdb33a-7b8b-4136-8adf-5683a47777e7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:43.212639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:43.214493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:43.215515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:43.215907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] PATH_INFO: `/v3/projects/d5b63cb66db94b978ae20c34aa92e830` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:43.220039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b63cb66db94b978ae20c34aa92e830)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:43.223822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:43.271684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:43.365679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b63cb66db94b978ae20c34aa92e830', 'request_id': 'req-d3dd1e48-1032-48ac-8b36-919778ac5916'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.375158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b63cb66db94b978ae20c34aa92e830', 'request_id': 'req-d3dd1e48-1032-48ac-8b36-919778ac5916'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.388916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b63cb66db94b978ae20c34aa92e830', 'request_id': 'req-d3dd1e48-1032-48ac-8b36-919778ac5916'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.402404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] The token cache is being invalidate because project d5b63cb66db94b978ae20c34aa92e830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:43.402833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.403573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.405895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1098/2147] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:43 2022] DELETE /identity/v3/projects/d5b63cb66db94b978ae20c34aa92e830 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:43.409987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:43.422722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cbe43-f505-4184-825a-a23d44b8014d service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:43.520753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:43.522405 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:43.523204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:43.523724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] PATH_INFO: `/v3/users/d8dbf48067844e5dad9f60aa926548e9` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:43.525657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8dbf48067844e5dad9f60aa926548e9)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:43.528125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:43.544064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:43.590936 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:43.593546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:43.618611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8dbf48067844e5dad9f60aa926548e9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.619489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8dbf48067844e5dad9f60aa926548e9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.629804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8dbf48067844e5dad9f60aa926548e9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.641047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8dbf48067844e5dad9f60aa926548e9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.661292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8dbf48067844e5dad9f60aa926548e9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:43.672207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1050/2148] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:43 2022] DELETE /identity/v3/users/d8dbf48067844e5dad9f60aa926548e9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:43.708765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd1e48-1032-48ac-8b36-919778ac5916 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:43.785340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:43.786357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:43.786674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:43.786954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:43.789058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:43.890112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:43.891921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a27887-a874-4d8c-80ea-cc2e662a519b service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:43.920014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1099/2149] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:44.238731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.240170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:44.377187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf76e0-a75c-4cf9-93f6-8fc6a00a5f2f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.392453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.393173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.393459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.393742 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] PATH_INFO: `/v3/projects/cb53ef8de8fc45acac150a49939a3e46` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.394943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb53ef8de8fc45acac150a49939a3e46)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.396902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.464943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb53ef8de8fc45acac150a49939a3e46', 'request_id': 'req-c589953b-35ff-4011-a4a8-e0a57fa2e758'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:44.472096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb53ef8de8fc45acac150a49939a3e46', 'request_id': 'req-c589953b-35ff-4011-a4a8-e0a57fa2e758'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:44.482848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb53ef8de8fc45acac150a49939a3e46', 'request_id': 'req-c589953b-35ff-4011-a4a8-e0a57fa2e758'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:44.501193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] The token cache is being invalidate because project cb53ef8de8fc45acac150a49939a3e46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:44.502138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:44.503281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c589953b-35ff-4011-a4a8-e0a57fa2e758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:44.505328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1051/2150] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:44 2022] DELETE /identity/v3/projects/cb53ef8de8fc45acac150a49939a3e46 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:44.512427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.512967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.512967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.534847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:44.536079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:44.541713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:44.617332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1100/2151] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:44.627247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.627786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.627786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.648234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:44.649689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:44.657749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1052/2152] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:44.662124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.672893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc936dc-a598-4e8c-a500-d4983103ea06 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.677575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.678203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.678474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.678747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.679403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:44.679713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.681940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.694374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1101/2153] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:44.698800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.712545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e02813-6260-48e3-9f88-5a76c5800e8d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.717614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.718424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.718866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.719142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.719790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.721753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.733256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:44.761051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1053/2154] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:44 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:44.765329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.775578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b34c12-c674-43d4-93dc-935e57f592b1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.839630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.840344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.840897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.841272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.841950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.843908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.868662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1102/2155] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:44 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:44.873174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.883498 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85071e0a-a4d6-4ea9-a029-751cd8950877 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.888515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.889119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.889393 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.889658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.890293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.891905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.905234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1054/2156] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:44.906395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.916833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bbbe2e-78f0-4ed4-8752-96aee58df55a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.921341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.921928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.922204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.922482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.923099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.924720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39041ba8-f80a-49a9-9424-3a96033a2a3e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.935784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1103/2157] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:44.940073 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:44.949928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0084-82e3-4946-b532-3d6755de0737 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:44.954569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:44.955212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:44.955494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:44.955768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] PATH_INFO: `/v3/projects/2f27ef5f9eac46218ec883fa3a811ad9/users/635ab773f2d746e7a96e8c0db2167bb2/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:44.970570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f27ef5f9eac46218ec883fa3a811ad9, user_id=635ab773f2d746e7a96e8c0db2167bb2, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:44.973266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:44.988537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1055/2158] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:44 2022] PUT /identity/v3/projects/2f27ef5f9eac46218ec883fa3a811ad9/users/635ab773f2d746e7a96e8c0db2167bb2/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:45.000100 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983f4-136f-4625-842f-7e47e5962790 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.000442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983f4-136f-4625-842f-7e47e5962790 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.000726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983f4-136f-4625-842f-7e47e5962790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.029463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-445983f4-136f-4625-842f-7e47e5962790 None None] MFA Rules not processed for user `635ab773f2d746e7a96e8c0db2167bb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:45.030750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-445983f4-136f-4625-842f-7e47e5962790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:45.098968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1104/2159] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:45.111534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.180578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ec8bd-e5f1-4aba-81c1-6b539a3c32cc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.185285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.185882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.186155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.186424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.187046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.188964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.215229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1056/2160] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:45 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:45.219303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445983f4-136f-4625-842f-7e47e5962790 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.226260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:45.232895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445983f4-136f-4625-842f-7e47e5962790 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.293939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.294520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.294799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.295076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.295704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.297677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.323156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1105/2161] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:45 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:45.324730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.337095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd468e-66df-4e6c-af01-bb8d81f9ba11 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.342689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.343513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.343893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.344337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.355822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.359845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.391416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1057/2162] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:45.393047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.408591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44941d5-6cf9-4fa7-98db-5fca410aada1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.417183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.417858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.418442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.418442 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] PATH_INFO: `/v3/projects/da32b81c34cd49bd9d8767b94bf64517/users/ae8cacf6627d450f96cf014feb0d9064/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.440974 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32b81c34cd49bd9d8767b94bf64517, user_id=ae8cacf6627d450f96cf014feb0d9064, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.444328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.465554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1106/2163] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:45 2022] PUT /identity/v3/projects/da32b81c34cd49bd9d8767b94bf64517/users/ae8cacf6627d450f96cf014feb0d9064/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:45.466379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.477467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990a79e-e187-4135-bcd8-bbda4aba45e8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.536766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.537479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.537831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.538111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.539940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.541601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266f5ea-ce38-4c2d-a56b-15a88b614aa9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.554342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1058/2164] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:45.558893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.570291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0ff0-4816-42a4-9003-d217df0bcb81 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.576353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.577117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.577466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.577806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] PATH_INFO: `/v3/projects/da32b81c34cd49bd9d8767b94bf64517/users/ae8cacf6627d450f96cf014feb0d9064/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.580737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da32b81c34cd49bd9d8767b94bf64517, user_id=ae8cacf6627d450f96cf014feb0d9064, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.583581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.604840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1107/2165] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:45 2022] PUT /identity/v3/projects/da32b81c34cd49bd9d8767b94bf64517/users/ae8cacf6627d450f96cf014feb0d9064/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:45.613205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.613493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.613767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.644518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] MFA Rules not processed for user `ae8cacf6627d450f96cf014feb0d9064`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:45.645738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:45.668668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:45.726164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1059/2166] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:45.739799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:45.741543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:45.802881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384ab0ae-bb48-4d6d-8ebf-1123509d21b1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:45.806545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:45.807149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:45.807429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:45.807702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:45.867503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:45.869031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c208940-2c8e-4650-88ed-803285e918f7 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:45.878162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1108/2167] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:46.919386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:46.920976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:46.989150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a69795d-aeb0-445c-b675-b799189fd1e7 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:46.994411 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:46.995038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:46.995313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:46.995601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] PATH_INFO: `/v3/users/520b3d7c1dfa42efb18cd661f9a85401` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:46.996834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=520b3d7c1dfa42efb18cd661f9a85401)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:46.998846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:47.048678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '520b3d7c1dfa42efb18cd661f9a85401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.049351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '520b3d7c1dfa42efb18cd661f9a85401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.062552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '520b3d7c1dfa42efb18cd661f9a85401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.072351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '520b3d7c1dfa42efb18cd661f9a85401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.086387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '520b3d7c1dfa42efb18cd661f9a85401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.095492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1060/2168] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:46 2022] DELETE /identity/v3/users/520b3d7c1dfa42efb18cd661f9a85401 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:47.097532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:47.098010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:47.098127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:47.120572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:47.121868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:47.127416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:47.186832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1109/2169] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:47.197624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:47.199183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:47.236830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:47.269274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f6a40-661c-463f-ba51-749479cb4456 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:47.273266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:47.274120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:47.274532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:47.274878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:47.285926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:47.288226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:47.308491 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1061/2170] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:47.857676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:47.859706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:47.873784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744409bf-f7a9-42aa-85f4-afe6ba404797 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:47.879735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:47.880602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:47.880983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:47.881358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] PATH_INFO: `/v3/projects/d8dc0bfce3ee49bfb20edd4da2b40607` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:47.888708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8dc0bfce3ee49bfb20edd4da2b40607)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:47.893492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:47.975773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:47.978123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:47.984553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8dc0bfce3ee49bfb20edd4da2b40607', 'request_id': 'req-fc46af32-52da-46f0-b91e-0633cf4f4d36'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:47.991286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8dc0bfce3ee49bfb20edd4da2b40607', 'request_id': 'req-fc46af32-52da-46f0-b91e-0633cf4f4d36'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.000086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8dc0bfce3ee49bfb20edd4da2b40607', 'request_id': 'req-fc46af32-52da-46f0-b91e-0633cf4f4d36'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.007522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32083429-7fc4-446d-bb31-f320b305b26e service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:48.012863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] The token cache is being invalidate because project d8dc0bfce3ee49bfb20edd4da2b40607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:48.012863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.013527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.015281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1110/2171] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:47 2022] DELETE /identity/v3/projects/d8dc0bfce3ee49bfb20edd4da2b40607 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:48.018990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:48.021485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:48.098614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:48.099526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:48.100007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:48.100453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] PATH_INFO: `/v3/users/77a345d8009541bd9d47e7990140a500` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:48.102404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77a345d8009541bd9d47e7990140a500)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:48.103206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46af32-52da-46f0-b91e-0633cf4f4d36 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:48.105194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:48.113354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:48.114844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:48.115124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:48.115395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] PATH_INFO: `/v3/users/e2144e7be96744a2a09255054aaacdeb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:48.117756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2144e7be96744a2a09255054aaacdeb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:48.120344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:48.180038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77a345d8009541bd9d47e7990140a500'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.180891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77a345d8009541bd9d47e7990140a500'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.193394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77a345d8009541bd9d47e7990140a500'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.194601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:48.208049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77a345d8009541bd9d47e7990140a500'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.212023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2144e7be96744a2a09255054aaacdeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.224872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2144e7be96744a2a09255054aaacdeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.229829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4eba779f-a841-429e-9eb3-6f73c94cbc8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77a345d8009541bd9d47e7990140a500'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.237673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1062/2172] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:47 2022] DELETE /identity/v3/users/77a345d8009541bd9d47e7990140a500 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:48.241879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2144e7be96744a2a09255054aaacdeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.244967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:48.245314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:48.245701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:48.249323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2144e7be96744a2a09255054aaacdeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.273487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:48.275077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:48.275499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2144e7be96744a2a09255054aaacdeb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:48.286910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1111/2173] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:48 2022] DELETE /identity/v3/users/e2144e7be96744a2a09255054aaacdeb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:48.328639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:48.348630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1063/2174] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:48.390038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:48.392897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:48.481249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbe5cf1-96f9-4a01-b482-b326f52416a1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:48.485938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:48.486573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:48.486857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:48.487133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:48.560160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:48.561666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:48.573803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1112/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:49.427166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.431215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:49.463314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a04057-08ea-490d-ba53-9417b209c877 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:49.472332 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:49.473324 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.473834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.474459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] PATH_INFO: `/v3/projects/63c61bb7d0ce4ace8470cd323b3aa7ea` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.477974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c61bb7d0ce4ace8470cd323b3aa7ea)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:49.480788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:49.494615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.496867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:49.540084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149bbe4-2802-410e-87e7-dc043554bb14 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:49.555745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:49.556447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.556843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.557125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] PATH_INFO: `/v3/projects/e553df9b4b604b38a6def4fb884c96fb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.560004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e553df9b4b604b38a6def4fb884c96fb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:49.562111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:49.584071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c61bb7d0ce4ace8470cd323b3aa7ea', 'request_id': 'req-5047718a-007b-4834-ae83-c26db085dee9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.595879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c61bb7d0ce4ace8470cd323b3aa7ea', 'request_id': 'req-5047718a-007b-4834-ae83-c26db085dee9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.617153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c61bb7d0ce4ace8470cd323b3aa7ea', 'request_id': 'req-5047718a-007b-4834-ae83-c26db085dee9'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.635613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] The token cache is being invalidate because project 63c61bb7d0ce4ace8470cd323b3aa7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:49.636193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.637224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.639251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1064/2176] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:49 2022] DELETE /identity/v3/projects/63c61bb7d0ce4ace8470cd323b3aa7ea => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:49.643675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.645523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:49.656445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e553df9b4b604b38a6def4fb884c96fb', 'request_id': 'req-614d9009-7625-4a0d-a2cc-585584246eb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.663386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e553df9b4b604b38a6def4fb884c96fb', 'request_id': 'req-614d9009-7625-4a0d-a2cc-585584246eb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.666193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:49.681667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e553df9b4b604b38a6def4fb884c96fb', 'request_id': 'req-614d9009-7625-4a0d-a2cc-585584246eb7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.695625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] The token cache is being invalidate because project e553df9b4b604b38a6def4fb884c96fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:49.695920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.696620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-614d9009-7625-4a0d-a2cc-585584246eb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.698396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1113/2177] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:49 2022] DELETE /identity/v3/projects/e553df9b4b604b38a6def4fb884c96fb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:49.702954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f1cb-81df-46a5-81e6-566d97728083 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.703332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f1cb-81df-46a5-81e6-566d97728083 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.703950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54f1cb-81df-46a5-81e6-566d97728083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.725796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ba54f1cb-81df-46a5-81e6-566d97728083 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:49.727381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047718a-007b-4834-ae83-c26db085dee9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:49.728068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ba54f1cb-81df-46a5-81e6-566d97728083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:49.791521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:49.792163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.792475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.792755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] PATH_INFO: `/v3/users/13642cb98d2c4b5292282d374235fffb` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.794010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=13642cb98d2c4b5292282d374235fffb)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:49.795956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:49.801516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1114/2178] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:49.809681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.809966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.810246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.827793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:49.832353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:49.833730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:49.843296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1115/2179] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:49.848177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.858787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326faa1-264f-43b4-bc5f-1675ace70c18 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:49.863759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:49.864133 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13642cb98d2c4b5292282d374235fffb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.864418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.864694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.864935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13642cb98d2c4b5292282d374235fffb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.865035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.865613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:49.865918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:49.868188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:49.875765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13642cb98d2c4b5292282d374235fffb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.885339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1116/2180] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:49.885574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13642cb98d2c4b5292282d374235fffb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.887559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.897629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617cc7d0-c14f-40b3-b085-8f8f15719069 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:49.899657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13642cb98d2c4b5292282d374235fffb'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:49.903450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:49.904155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:49.904543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:49.905553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:49.905553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:49.907377 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1065/2181] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:49 2022] DELETE /identity/v3/users/13642cb98d2c4b5292282d374235fffb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:49.907623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:49.940093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1117/2182] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:49 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:49.945530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:49.950387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.082993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7337d83-5937-48f5-a92b-7223b06d9f9a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.164823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.165524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.165867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.166217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.166885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.169168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.202594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1066/2183] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:49 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:50.206398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.219233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e3f53-5a32-445f-8408-c253aec2a148 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.230542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.231547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.232127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.232711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.233945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.236353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.249469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1118/2184] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:50.253298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.269141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce34b494-b807-42aa-a471-59a331eb508b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.275142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.275918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.276366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.276726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.277447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.279743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.295421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1067/2185] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:50.296910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.312094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c23e-9c6f-42ad-93f2-3f287af759dd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.325181 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.325885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.326162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.326431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] PATH_INFO: `/v3/projects/0489615791564a848ced57c622b789c6/users/8848d0fe390542338f4a5a62d57ebf21/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.347648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0489615791564a848ced57c622b789c6, user_id=8848d0fe390542338f4a5a62d57ebf21, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.351059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf63c888-a75a-4d4c-8af7-a798bc90d8c5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.378263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1119/2186] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:50 2022] PUT /identity/v3/projects/0489615791564a848ced57c622b789c6/users/8848d0fe390542338f4a5a62d57ebf21/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:50.378816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.382745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.389977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.390264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.390539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.398275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6622096-d728-4148-9ff6-c2b51d380f0a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.444357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:50.467591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] MFA Rules not processed for user `8848d0fe390542338f4a5a62d57ebf21`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:50.469007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.515666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.516422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.516831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.517166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] PATH_INFO: `/v3/projects/c9f1ec188b504422a247163ba6ae0e2e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.518362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9f1ec188b504422a247163ba6ae0e2e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.520692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.544067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:50.552301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1120/2187] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:50.552301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.552301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.581409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9f1ec188b504422a247163ba6ae0e2e', 'request_id': 'req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.587969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9f1ec188b504422a247163ba6ae0e2e', 'request_id': 'req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.597107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9f1ec188b504422a247163ba6ae0e2e', 'request_id': 'req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.611475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] The token cache is being invalidate because project c9f1ec188b504422a247163ba6ae0e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:50.611766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.612485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.614194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1068/2188] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:50 2022] DELETE /identity/v3/projects/c9f1ec188b504422a247163ba6ae0e2e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:50.614947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.616240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.631180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae2f41-92fe-4fe9-8254-d63c669e948f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.688825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.689470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.689797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.690072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.692106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc97fe0-aee5-4a4c-8ff0-93b71283a03b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.692306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.698316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.699264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.699555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.700371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.701063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.703313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.743564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1069/2189] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:50 2022] POST /identity/v3/projects => generated 375 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:50.743564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.746107 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:50.776005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.776005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.789421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1121/2190] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:50.790315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.808121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef018d-6f93-41a2-8318-65770de59f14 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.839555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:50.863209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02b820-227b-43c4-ae2d-7828f57a1c2b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.868147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.869010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.869289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.869564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] PATH_INFO: `/v3/users/773917426e8a43b2bf729db0c8533e7f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.870702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=773917426e8a43b2bf729db0c8533e7f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.872821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.881782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.882408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.883567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.883847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.884819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.887403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.899302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:50.913085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1122/2191] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:50 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:50.917217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.928115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317239e-f8da-4eaa-8954-8012b38c84cf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.932775 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773917426e8a43b2bf729db0c8533e7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.933488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773917426e8a43b2bf729db0c8533e7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.933788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.934396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.934678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.934955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.935604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:50.937255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:50.942606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773917426e8a43b2bf729db0c8533e7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.950978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1123/2192] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:57:50.953000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773917426e8a43b2bf729db0c8533e7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.955059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:50.965834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa3879-f31a-4e42-9208-9b55ec43d4e4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:50.970010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773917426e8a43b2bf729db0c8533e7f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:50.972042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:50.972967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:50.973254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:50.973578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] PATH_INFO: `/v3/projects/ef193e4e813a49a08b7c8bb5016e09da/users/3d537f85675047bda4165fe83c46e311/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:50.977474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1070/2193] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:50 2022] DELETE /identity/v3/users/773917426e8a43b2bf729db0c8533e7f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:50.995791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef193e4e813a49a08b7c8bb5016e09da, user_id=3d537f85675047bda4165fe83c46e311, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.000240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.016694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1124/2194] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:50 2022] PUT /identity/v3/projects/ef193e4e813a49a08b7c8bb5016e09da/users/3d537f85675047bda4165fe83c46e311/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:51.021481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.022856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.107036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce69a8-7204-46b2-aa65-593211da8bd7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.189906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.190532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.190810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.191084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.191733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.193363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294c954-a05f-487b-a23a-eff3a1ebbede admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.205913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1071/2195] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:51.210238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.222176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffed911-5051-4702-b539-c94bb3371250 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.227158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.227852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.228134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.228432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] PATH_INFO: `/v3/projects/ef193e4e813a49a08b7c8bb5016e09da/users/3d537f85675047bda4165fe83c46e311/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.230742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef193e4e813a49a08b7c8bb5016e09da, user_id=3d537f85675047bda4165fe83c46e311, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.233516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.255797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1125/2196] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:51 2022] PUT /identity/v3/projects/ef193e4e813a49a08b7c8bb5016e09da/users/3d537f85675047bda4165fe83c46e311/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:51.259331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.259663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.259988 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.268819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:51.291526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] MFA Rules not processed for user `3d537f85675047bda4165fe83c46e311`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:51.292789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.298031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.299801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.390384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1072/2197] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:51.401782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.403218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.422746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf891c-1191-45b5-9fe2-995c7c8c621a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.427648 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.428289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.428797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.429219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] PATH_INFO: `/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.431154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d3d87214aaf4a35a3670cc7b35a826f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.435103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.469317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903895d1-060b-44b6-a738-89111dbe6566 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.474398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.474688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.475144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.475691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.478439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.501315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d3d87214aaf4a35a3670cc7b35a826f', 'request_id': 'req-b67d4898-3881-4aca-aab1-795bb213b93f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:51.508026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d3d87214aaf4a35a3670cc7b35a826f', 'request_id': 'req-b67d4898-3881-4aca-aab1-795bb213b93f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:51.517704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d3d87214aaf4a35a3670cc7b35a826f', 'request_id': 'req-b67d4898-3881-4aca-aab1-795bb213b93f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:51.544994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] The token cache is being invalidate because project 0d3d87214aaf4a35a3670cc7b35a826f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:51.546025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:51.547009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b67d4898-3881-4aca-aab1-795bb213b93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:51.553940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1126/2198] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:51 2022] DELETE /identity/v3/projects/0d3d87214aaf4a35a3670cc7b35a826f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:57:51.556560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.556852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.557132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.577175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.579331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:51.579658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb5908-9e26-4389-8fde-8085277bccc1 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.580490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.594585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1073/2199] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:51.627050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:51.695858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1127/2200] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:51.703953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.704432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.704776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.728296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:51.729467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:51.754516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.764445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1074/2201] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:51.770199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145b919-8d66-48a1-9da4-cd0514112778 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.778505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.779398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.779832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.781506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.782794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:51.783483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.786515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.809911 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1128/2202] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:51.815122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.831000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcba6ab-0ffa-41e1-9c6c-b31c71a09547 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:51.839940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:51.840851 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:51.841236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:51.842170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:51.843092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:51.846501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:51.926104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1075/2203] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:51 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:51.930917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:51.947899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659e3c3-86da-48ef-acbd-b421b71526cf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:52.044425 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:52.045180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.047350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.047905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.048710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:52.051141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:52.079407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1129/2204] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:51 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:57:52.080916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:52.092245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f6d96-3349-421f-98b4-a5d9d1887aef admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:52.097495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:52.098104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.098386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.098656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.099298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:52.100954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:52.112086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1076/2205] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:52.116263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:52.127456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ad8c7-fc53-4c5c-a68c-a5f5eae9d0f0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:52.132115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:52.132769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.133096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.133371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.134007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:52.135608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b0464-e117-4c00-bdb0-478683e4d4be admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:52.145897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1130/2206] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:52.149979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:52.156353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:52.160020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de99c0e-3626-47fb-b7ef-919113616d1a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:52.166236 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:52.166878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.167160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.167437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] PATH_INFO: `/v3/projects/4105945a19cc4b81ac64fd94004802ad/users/fc20609cd99041d0b2509095e8a0c1b6/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.182791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=4105945a19cc4b81ac64fd94004802ad, user_id=fc20609cd99041d0b2509095e8a0c1b6, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:52.185632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:52.199519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1077/2207] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:52 2022] PUT /identity/v3/projects/4105945a19cc4b81ac64fd94004802ad/users/fc20609cd99041d0b2509095e8a0c1b6/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:52.204524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.204964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.205238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.224124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:52.225370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:52.285658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1131/2208] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:52.295711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:52.297447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:52.357215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985942a9-50b4-4336-8d95-7e24e23ed6ce admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:52.361497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:52.362153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:52.362437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:52.362712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:52.373863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:52.375320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838e2d-3643-4fd3-be60-62ac0e7ebba5 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:52.393891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1078/2209] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:54.377880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:54.386212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:54.398377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f54d5a-3307-4632-9f2b-bca6b948265a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:54.410718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:54.412108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:54.412471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:54.413259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] PATH_INFO: `/v3/users/8848d0fe390542338f4a5a62d57ebf21` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:54.415546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8848d0fe390542338f4a5a62d57ebf21)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:54.419030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:54.497379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:54.506807 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8848d0fe390542338f4a5a62d57ebf21'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:54.516127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8848d0fe390542338f4a5a62d57ebf21'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:54.525061 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8848d0fe390542338f4a5a62d57ebf21'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:54.526106 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8848d0fe390542338f4a5a62d57ebf21'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:54.544129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8848d0fe390542338f4a5a62d57ebf21'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:54.556447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1132/2210] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:54 2022] DELETE /identity/v3/users/8848d0fe390542338f4a5a62d57ebf21 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:54.558628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:54.559072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:54.559072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:54.583059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:54.583870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:54.676527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1079/2211] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:54.691809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:54.694312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:54.796117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34edda-2bbd-4a68-a59f-50a8fe5e0e8e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:54.800630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:54.801298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:54.802563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:54.802852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:54.828925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:54.831953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:54.847047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1133/2212] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:57:55.861322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:55.862914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:55.889501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21127ffb-ce41-4e09-aec7-b024ffc5e425 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:55.901764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:55.902434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:55.902716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:55.902986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] PATH_INFO: `/v3/projects/0489615791564a848ced57c622b789c6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:55.904141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0489615791564a848ced57c622b789c6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:55.906823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:55.912855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:55.915664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:55.936484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20383e-6cad-482f-a2cf-ba0ad6fb416b service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:55.954908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:55.956432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:55.956971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:55.957468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] PATH_INFO: `/v3/users/635ab773f2d746e7a96e8c0db2167bb2` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:55.960044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=635ab773f2d746e7a96e8c0db2167bb2)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:55.965453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:56.025660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0489615791564a848ced57c622b789c6', 'request_id': 'req-d0635f04-8212-4383-be4b-c2435d36eed5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.042034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0489615791564a848ced57c622b789c6', 'request_id': 'req-d0635f04-8212-4383-be4b-c2435d36eed5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.060615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0489615791564a848ced57c622b789c6', 'request_id': 'req-d0635f04-8212-4383-be4b-c2435d36eed5'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.063005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '635ab773f2d746e7a96e8c0db2167bb2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.081624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '635ab773f2d746e7a96e8c0db2167bb2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.089625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] The token cache is being invalidate because project 0489615791564a848ced57c622b789c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:56.091429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.094278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.097755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '635ab773f2d746e7a96e8c0db2167bb2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.103575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '635ab773f2d746e7a96e8c0db2167bb2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.103750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1080/2213] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:55 2022] DELETE /identity/v3/projects/0489615791564a848ced57c622b789c6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:56.103750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:56.106917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:56.122090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:56.130721 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bab3c6ff-f6df-4104-b212-7c5a69e0ce6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '635ab773f2d746e7a96e8c0db2167bb2'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.140906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1134/2214] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:55 2022] DELETE /identity/v3/users/635ab773f2d746e7a96e8c0db2167bb2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:56.145598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:56.146254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:56.147194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:56.178503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:56.181220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:56.232069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:56.251284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0635f04-8212-4383-be4b-c2435d36eed5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:56.334044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:56.334871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:56.335151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:56.335623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] PATH_INFO: `/v3/users/3d537f85675047bda4165fe83c46e311` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:56.337464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d537f85675047bda4165fe83c46e311)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:56.340153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:56.343245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1135/2215] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:56.385359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:56.389478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:56.458188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d537f85675047bda4165fe83c46e311'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.458922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d537f85675047bda4165fe83c46e311'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.474591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d537f85675047bda4165fe83c46e311'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.509074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d537f85675047bda4165fe83c46e311'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.536154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d537f85675047bda4165fe83c46e311'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:56.550877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eceee35-66cf-4a66-94b0-0ed26405b061 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:56.552621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1081/2216] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:56 2022] DELETE /identity/v3/users/3d537f85675047bda4165fe83c46e311 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:56.643401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:56.644054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:56.644333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:56.644644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:56.646851 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:56.746634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:56.748252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:56.765010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1136/2217] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:57:57.634127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:57.635648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:57.657744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83283a9-def4-473a-9c1f-0dedd919db5f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:57.666014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:57.667093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:57.667627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:57.668949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] PATH_INFO: `/v3/projects/ef193e4e813a49a08b7c8bb5016e09da` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:57.671815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef193e4e813a49a08b7c8bb5016e09da)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:57.685233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:57.749475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:57.752661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:57.761205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:57.771791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d39415-b97b-4b63-b538-f29360c7c697 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:57.818083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef193e4e813a49a08b7c8bb5016e09da', 'request_id': 'req-d29d2dca-7851-4103-adf4-9c601d78beb3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:57.836615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef193e4e813a49a08b7c8bb5016e09da', 'request_id': 'req-d29d2dca-7851-4103-adf4-9c601d78beb3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:57.852993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef193e4e813a49a08b7c8bb5016e09da', 'request_id': 'req-d29d2dca-7851-4103-adf4-9c601d78beb3'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:57.877700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] The token cache is being invalidate because project ef193e4e813a49a08b7c8bb5016e09da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:57.877997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:57.879433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d29d2dca-7851-4103-adf4-9c601d78beb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:57.883890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1082/2218] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:57 2022] DELETE /identity/v3/projects/ef193e4e813a49a08b7c8bb5016e09da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:57.888985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bcaff-2131-4d8a-85e7-f9163ddc4b81 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:57.889412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bcaff-2131-4d8a-85e7-f9163ddc4b81 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:57.889701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bcaff-2131-4d8a-85e7-f9163ddc4b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:57.895367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:57.940767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2d5bcaff-2131-4d8a-85e7-f9163ddc4b81 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:57.942029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2d5bcaff-2131-4d8a-85e7-f9163ddc4b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:57.954938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:57.955591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:57.955872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:57.956138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] PATH_INFO: `/v3/projects/2f27ef5f9eac46218ec883fa3a811ad9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:57.957660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f27ef5f9eac46218ec883fa3a811ad9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:57.959606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.053894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f27ef5f9eac46218ec883fa3a811ad9', 'request_id': 'req-84a9642b-ac91-4409-920c-e912289cfc14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.070223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1083/2219] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:57:58.070431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f27ef5f9eac46218ec883fa3a811ad9', 'request_id': 'req-84a9642b-ac91-4409-920c-e912289cfc14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.072121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2450a1-6dc9-45ad-b2e2-a4628d04c805 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.072121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2450a1-6dc9-45ad-b2e2-a4628d04c805 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.072384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2450a1-6dc9-45ad-b2e2-a4628d04c805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.083742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f27ef5f9eac46218ec883fa3a811ad9', 'request_id': 'req-84a9642b-ac91-4409-920c-e912289cfc14'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.107412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] The token cache is being invalidate because project 2f27ef5f9eac46218ec883fa3a811ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:58.107765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.108930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4c2450a1-6dc9-45ad-b2e2-a4628d04c805 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:58.110146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4c2450a1-6dc9-45ad-b2e2-a4628d04c805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.111679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.113581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1137/2220] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:57 2022] DELETE /identity/v3/projects/2f27ef5f9eac46218ec883fa3a811ad9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:58.117995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.119683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.210833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1084/2221] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:58.212636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.213252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.213890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.228732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9642b-ac91-4409-920c-e912289cfc14 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.233898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.234533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.234808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.235079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] PATH_INFO: `/v3/users/ae8cacf6627d450f96cf014feb0d9064` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.236208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae8cacf6627d450f96cf014feb0d9064)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.238164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.246946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] MFA Rules not processed for user `fc20609cd99041d0b2509095e8a0c1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:58.248246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.317580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:58.325226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae8cacf6627d450f96cf014feb0d9064'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.334708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae8cacf6627d450f96cf014feb0d9064'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.344617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae8cacf6627d450f96cf014feb0d9064'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.345401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae8cacf6627d450f96cf014feb0d9064'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.347731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1085/2222] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:58.349313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.351873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:58.363294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae8cacf6627d450f96cf014feb0d9064'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:58.365769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d49c3-de50-4fb5-a4df-0e06b56d8582 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.371690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1138/2223] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:57:58 2022] DELETE /identity/v3/users/ae8cacf6627d450f96cf014feb0d9064 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:58.372595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.373898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.386185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.387752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.388167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.389197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.393378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:58.393893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.399512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.435549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1086/2224] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:58.440693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.443891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.471551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a0b0b-7fb4-4df9-a542-7eb70a350fe7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.491493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e161f2-fe44-4145-ab77-76399d277e1d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.500190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.501305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.501458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.502446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.502446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.505475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.559880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1139/2225] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:58.561764 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.603974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.604721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.605433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.606675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.607564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.610386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.661685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1087/2226] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/projects => generated 371 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:58.668616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.702185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206a5e2-9258-4644-aaff-e13963e3cded admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.842135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8091469-2cc1-4430-bab0-a3b8860429c6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:58.858221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.858221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.859864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.860813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.862063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.867594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.870168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:58.871374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:58.871785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:58.873366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:58.874572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:58.879355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:58.937767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1088/2227] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:58.940220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.951203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:58.975072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1140/2228] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:58 2022] POST /identity/v3/users => generated 292 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:58.980282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:58.991905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ef2ec-692b-4655-96a6-2e9195ce76a7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.008248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30c554-5bec-4846-9cda-7dbd9c549c7a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.009475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.010356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.010828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.011615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] PATH_INFO: `/v3/projects/da32b81c34cd49bd9d8767b94bf64517` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.020120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.020782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.021064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.021348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.022008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.026692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.028303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da32b81c34cd49bd9d8767b94bf64517)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.032771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:59.033641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.053806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1141/2229] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:59.055174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.080530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b74bd5-7711-4af7-b504-fa49fc6276a9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.090032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.091322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.091640 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.091925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.092614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.094720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.131089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:59.131710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1142/2230] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:59.132828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.136443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da32b81c34cd49bd9d8767b94bf64517', 'request_id': 'req-34c824c3-6655-4022-bcb4-234956bf2db2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:59.151114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da32b81c34cd49bd9d8767b94bf64517', 'request_id': 'req-34c824c3-6655-4022-bcb4-234956bf2db2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:59.158920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca42653-e9b0-4bdc-9d28-a6c1d4f5781a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.168979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da32b81c34cd49bd9d8767b94bf64517', 'request_id': 'req-34c824c3-6655-4022-bcb4-234956bf2db2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:59.203987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] The token cache is being invalidate because project da32b81c34cd49bd9d8767b94bf64517 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:57:59.204284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:59.205925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:57:59.216206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1089/2231] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:57:58 2022] DELETE /identity/v3/projects/da32b81c34cd49bd9d8767b94bf64517 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:59.219993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.225697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.369918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.370146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c824c3-6655-4022-bcb4-234956bf2db2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.370680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.371053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.371617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.372698 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.374754 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10294c-337a-4aee-9255-0effcfd6aa15 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.382746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.383448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.383732 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.384010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] PATH_INFO: `/v3/projects/13209b5faa5e4d628428dc0c9af9b51e/users/c18678c9e7c749c6bea0094407f53573/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.411938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1143/2232] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:59.414574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.415093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.415580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.424594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13209b5faa5e4d628428dc0c9af9b51e, user_id=c18678c9e7c749c6bea0094407f53573, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.427465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.448444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:59.450562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.462398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1090/2233] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:59 2022] PUT /identity/v3/projects/13209b5faa5e4d628428dc0c9af9b51e/users/c18678c9e7c749c6bea0094407f53573/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:59.462398 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.464619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.555048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1144/2234] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:59.555994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.570572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39a5a2-cb9a-46ec-a394-82177c697578 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.572559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d1941-8999-4ff4-a702-8a17f768057d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.576218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.576935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.577282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.577614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.578329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.580187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.580821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09bf69-6ff5-434a-a2ab-f846bc566e43 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.580948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.581160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.581438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] PATH_INFO: `/v3/projects/dff87872d4834c03bd689b9a6fa4579e/users/616ea15bf7ae4ab6afa632b00f07ec17/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.599883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1145/2235] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:57:59.599883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.599883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.599883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.626737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff87872d4834c03bd689b9a6fa4579e, user_id=616ea15bf7ae4ab6afa632b00f07ec17, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.631383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:59.633444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.633951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.646940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1146/2236] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:59.647951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.661961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1091/2237] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:59 2022] PUT /identity/v3/projects/dff87872d4834c03bd689b9a6fa4579e/users/616ea15bf7ae4ab6afa632b00f07ec17/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:59.662913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.665508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b8a8d4-598e-4f0d-bacc-2df23995d218 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.714269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:59.745043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced3c9a-18a8-4555-a94a-b1f3a426d325 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.752238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.753426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.754082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.754457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.755314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.755632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.755981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] PATH_INFO: `/v3/projects/13209b5faa5e4d628428dc0c9af9b51e/users/c18678c9e7c749c6bea0094407f53573/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.756226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.758698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:57:59.759116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.759635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=13209b5faa5e4d628428dc0c9af9b51e, user_id=c18678c9e7c749c6bea0094407f53573, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.760991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35cdcd-2064-4b82-9e54-28d2f523f6ea admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.762919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.770624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:59.779383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1092/2238] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:57:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:57:59.781079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.781602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.782089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.785716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1147/2239] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:57:59 2022] PUT /identity/v3/projects/13209b5faa5e4d628428dc0c9af9b51e/users/c18678c9e7c749c6bea0094407f53573/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:59.786843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.811892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:57:59.814280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.913335 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f322bd7-719d-44ed-9bc1-737a5915eafb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:57:59.920454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:57:59.921004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:57:59.921386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:57:59.921781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:57:59.922659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:57:59.925247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:57:59.930596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1093/2240] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:57:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:57:59.941680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:57:59.943552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:57:59.970102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1148/2241] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:57:59 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:57:59.975056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:00.057002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acfb779-6548-4fa8-b8a2-af7bdaf4cfe8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.070734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c7626-4537-4d2e-9d43-04ed7f34d5ed admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.077762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.078483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.078893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.079365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.079986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.082210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.122230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1149/2242] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:57:59 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:00.127401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.128016 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.128292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.128433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:00.128593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.140101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c29aa6-b24e-4a33-a6ca-dbbea56c922d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.140937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.142730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.146154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.147036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.147534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.148097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.149031 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.150982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.158953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1094/2243] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:58:00.163251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1150/2244] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:58:00.167362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:00.178623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc9d2be-450f-43fe-ac8d-eabcf8369b82 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.187229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.188378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.188763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.189205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.190754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.193014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27246f28-a11b-4060-af43-4b2b54580aac admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.210279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1095/2245] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:00.213979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:00.224738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae7381-dcb2-4e21-bbe4-0fbd497150f2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.229878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.230827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.231105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.231478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] PATH_INFO: `/v3/projects/c6e133e880fa4fec82c0b928ce88398a/users/fa3e1290aa2b4167b32089d9ae8fcc82/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.250486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e133e880fa4fec82c0b928ce88398a, user_id=fa3e1290aa2b4167b32089d9ae8fcc82, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.254224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.288328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731c15-e5ef-4c72-bc30-34d63a2b1fcc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.290533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731c15-e5ef-4c72-bc30-34d63a2b1fcc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.290657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1151/2246] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:58:00 2022] PUT /identity/v3/projects/c6e133e880fa4fec82c0b928ce88398a/users/fa3e1290aa2b4167b32089d9ae8fcc82/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:00.290961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa731c15-e5ef-4c72-bc30-34d63a2b1fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.368907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fa731c15-e5ef-4c72-bc30-34d63a2b1fcc None None] MFA Rules not processed for user `fa3e1290aa2b4167b32089d9ae8fcc82`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:00.374071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fa731c15-e5ef-4c72-bc30-34d63a2b1fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:00.415258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:00.515269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1096/2247] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:00.531060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:00.533577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:00.659604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:00.680982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb04ff-b3fd-4b33-a641-ee69a8f0c132 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:00.686877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:00.687946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:00.688331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:00.688839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:00.704158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:00.706226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f562764-31c6-40e0-9e97-2e59d163f2d0 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:00.718738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1152/2248] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:02.423160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a194-1b76-41ab-9691-152773360005 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:02.423731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a194-1b76-41ab-9691-152773360005 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:02.423967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b84a194-1b76-41ab-9691-152773360005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:02.483821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0b84a194-1b76-41ab-9691-152773360005 None None] MFA Rules not processed for user `616ea15bf7ae4ab6afa632b00f07ec17`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:02.484748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0b84a194-1b76-41ab-9691-152773360005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:02.670159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1097/2249] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:02.693831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66472b-0469-437a-9953-5412a457bb11 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:02.694320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66472b-0469-437a-9953-5412a457bb11 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:02.694516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66472b-0469-437a-9953-5412a457bb11 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:02.696524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1153/2250] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 02:58:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:02.716289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84a194-1b76-41ab-9691-152773360005 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:02.740695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b84a194-1b76-41ab-9691-152773360005 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:02.753574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:02.754304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:02.754844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:02.754844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:02.772035 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:02.773753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:02.777025 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:02.777381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:02.777745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:02.796451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1098/2251] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:02.836941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] MFA Rules not processed for user `51e6b673144045b5baffab410e261706`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:02.841197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:02.880318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:02.883015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:03.028522 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49d5f7-5335-404e-ab28-8d089a8fefd2 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:03.039110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1154/2252] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 02:58:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:03.041961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:03.042642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:03.042924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:03.043205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] PATH_INFO: `/v3/users/58f1742030694f7d8203b220c485a7d2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:03.047128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f1742030694f7d8203b220c485a7d2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:03.049162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:03.054155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:03.055592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:03.087730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c8e2-6f6e-4740-bef4-e7bc674d30d3 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:03.109706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:03.111339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:03.111624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:03.111899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:03.123653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:03.126664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:03.128288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:03.157006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1155/2253] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:58:03.216817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f1742030694f7d8203b220c485a7d2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.217907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f1742030694f7d8203b220c485a7d2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.221934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:03.223399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:03.233569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f1742030694f7d8203b220c485a7d2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.239269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd3bcd-44d0-4e53-b475-1737a3caaf39 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:03.244963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:03.245973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:03.246529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:03.247046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:03.247801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f1742030694f7d8203b220c485a7d2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.249503 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:03.280615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f1742030694f7d8203b220c485a7d2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.307482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1099/2254] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:02 2022] DELETE /identity/v3/users/58f1742030694f7d8203b220c485a7d2 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:58:03.402844 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:03.404662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828ccdc6-5ef1-4ac7-b594-04930bcee66a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:03.441470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1156/2255] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:03.641814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:03.643560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:03.783883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b0c12-3196-4829-b5dc-220abd33516c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:03.790896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:03.791557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:03.792502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:03.792794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] PATH_INFO: `/v3/projects/a3e11c787c1741159db33aa4d9723bed` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:03.794512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3e11c787c1741159db33aa4d9723bed)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:03.798192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:03.938966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3e11c787c1741159db33aa4d9723bed', 'request_id': 'req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.956590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3e11c787c1741159db33aa4d9723bed', 'request_id': 'req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:03.980190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3e11c787c1741159db33aa4d9723bed', 'request_id': 'req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:04.009376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] The token cache is being invalidate because project a3e11c787c1741159db33aa4d9723bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:04.009676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:04.011663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f6768871-92ef-4db3-8fab-a3d80ef2bd3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:04.014927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1100/2256] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:03 2022] DELETE /identity/v3/projects/a3e11c787c1741159db33aa4d9723bed => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:04.019887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.020351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.020558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.044296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:04.045680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:04.160864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:04.176787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1157/2257] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:04.185738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.186037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.186296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.212023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:04.213415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:04.221981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1101/2258] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:04.228292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.242710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd4518b-de10-486c-909f-7f9838416a40 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.248201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.248902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.249185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.249463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.250129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:58:04.250437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.252055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.272172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1158/2259] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:58:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:58:04.273175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.286667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deafa33-8390-48c7-bdd2-f3c2620a3736 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.293340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.294056 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.294582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.294927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.296596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.305099 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6aa25-de2a-4ffa-9402-742e7dfb6b2a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.346813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1102/2260] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:58:04.351573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.374561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16bc-6427-4796-8f76-2791fa57d795 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.510474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.513445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.513782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.515825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.516551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.518628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.555483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1159/2261] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:04.557361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.559440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107fbe-fad6-4c7d-a522-ba75a3000e98 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.559954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107fbe-fad6-4c7d-a522-ba75a3000e98 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.560765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5107fbe-fad6-4c7d-a522-ba75a3000e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.573603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501f70d-44fa-4274-8f23-dc275ceb9483 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.589727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.590091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.590507 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.590849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.591599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.593410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.596247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:04.607466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e5107fbe-fad6-4c7d-a522-ba75a3000e98 None None] MFA Rules not processed for user `616ea15bf7ae4ab6afa632b00f07ec17`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:04.615359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e5107fbe-fad6-4c7d-a522-ba75a3000e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:04.620102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1160/2262] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:04.624135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.635763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616f258-548b-4018-9b61-4208c167708f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.645297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.646281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.646281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.646524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.647093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.650136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.675421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1161/2263] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:04 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:04.676344 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.707358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b03c6-fb55-41c8-8ac6-a3e2393e5a00 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:04.721914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:04.722890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.723342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.723459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1103/2264] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:04.724231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] PATH_INFO: `/v3/projects/da9fa408f8714e5ebdbbc2de123efc70/users/9986a3dc2450420abf8c260c4c8d109b/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.748077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9fa408f8714e5ebdbbc2de123efc70, user_id=9986a3dc2450420abf8c260c4c8d109b, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:04.751700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:04.774278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1162/2265] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:58:04 2022] PUT /identity/v3/projects/da9fa408f8714e5ebdbbc2de123efc70/users/9986a3dc2450420abf8c260c4c8d109b/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:04.779336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedffd-1dd8-49ee-aa6c-055b0c6db10d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:04.779763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedffd-1dd8-49ee-aa6c-055b0c6db10d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:04.780219 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daedffd-1dd8-49ee-aa6c-055b0c6db10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:04.814243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4daedffd-1dd8-49ee-aa6c-055b0c6db10d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:04.816317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4daedffd-1dd8-49ee-aa6c-055b0c6db10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:04.927931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:04.928489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1104/2266] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:04.931396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:05.020762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f37d-4713-4d3b-84e6-9fd7a07f7ac0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:05.027283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:05.027897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:05.028176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:05.028481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:05.053323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:05.056224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:05.098697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1163/2267] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:09.261712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06806a-d1e1-481c-bfd6-09666a110967 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:09.262068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06806a-d1e1-481c-bfd6-09666a110967 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:09.262244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06806a-d1e1-481c-bfd6-09666a110967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:09.359579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3c06806a-d1e1-481c-bfd6-09666a110967 None None] MFA Rules not processed for user `c18678c9e7c749c6bea0094407f53573`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:09.361652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3c06806a-d1e1-481c-bfd6-09666a110967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:09.638109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1105/2268] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:09.702089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:09.704163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:09.760544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:09.890395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27388f09-9aad-4f01-936a-108e0bb117ed service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:09.906803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:09.907239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:09.907523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:09.907792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:09.909910 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:09.990806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:09.994333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34544d-a71b-454a-a1cd-27b46944b7a5 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:10.008652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1164/2269] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:12.937999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:12.939554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:12.939908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:12.978668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] MFA Rules not processed for user `fc20609cd99041d0b2509095e8a0c1b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:12.980369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:12.998325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1106/2270] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:14.228330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5a363-e756-443b-9255-740b5fd1ae87 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:14.228822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5a363-e756-443b-9255-740b5fd1ae87 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:14.229164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5a363-e756-443b-9255-740b5fd1ae87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:14.276027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2af5a363-e756-443b-9255-740b5fd1ae87 None None] MFA Rules not processed for user `9986a3dc2450420abf8c260c4c8d109b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:14.277816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2af5a363-e756-443b-9255-740b5fd1ae87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:14.358703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1165/2271] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:14.422004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:14.440231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb9fffe-dd79-4a62-b659-afffeb9ece70 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:14.447757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:14.448475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:14.448759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:14.449033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:14.457472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:14.466316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:14.480119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1107/2272] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:16.522606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bdfbb-40f7-468b-9ed3-30d6aa8525e5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:16.523168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bdfbb-40f7-468b-9ed3-30d6aa8525e5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:16.523168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08bdfbb-40f7-468b-9ed3-30d6aa8525e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:16.551535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c08bdfbb-40f7-468b-9ed3-30d6aa8525e5 None None] MFA Rules not processed for user `9986a3dc2450420abf8c260c4c8d109b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:16.553154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c08bdfbb-40f7-468b-9ed3-30d6aa8525e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:16.563897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1166/2273] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:17.847620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:17.849580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:17.868422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40e39e3-4d0a-4db9-81cb-7f722523d7b9 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:17.876542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:17.879308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:17.880913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:17.882379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] PATH_INFO: `/v3/users/fa3e1290aa2b4167b32089d9ae8fcc82` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:17.884570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa3e1290aa2b4167b32089d9ae8fcc82)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:17.886908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:17.922537 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:17.989120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa3e1290aa2b4167b32089d9ae8fcc82'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:17.991371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa3e1290aa2b4167b32089d9ae8fcc82'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.009397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa3e1290aa2b4167b32089d9ae8fcc82'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.022684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa3e1290aa2b4167b32089d9ae8fcc82'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.062293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa3e1290aa2b4167b32089d9ae8fcc82'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.070789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1108/2274] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:17 2022] DELETE /identity/v3/users/fa3e1290aa2b4167b32089d9ae8fcc82 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:18.075437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:18.075926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:18.076088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:18.114928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:18.116982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:18.194628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:18.210925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1167/2275] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:18.221519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:18.223764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:18.297476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75537e1e-6905-4774-9123-806b6b5811bf admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:18.305610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:18.306428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:18.306675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:18.307022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:18.318559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:18.320008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f31b6-6ac7-41c4-bebe-3a97fc475205 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:18.331769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1109/2276] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:18.735945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:18.737399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:18.775050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67600939-8536-4eab-b4c6-9d98e86a23ad None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:18.780817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:18.781715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:18.782222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:18.782416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] PATH_INFO: `/v3/projects/c6e133e880fa4fec82c0b928ce88398a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:18.784632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e133e880fa4fec82c0b928ce88398a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:18.786633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:18.847847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e133e880fa4fec82c0b928ce88398a', 'request_id': 'req-cfc0f711-55ce-4653-84e7-f30817d74800'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.853726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e133e880fa4fec82c0b928ce88398a', 'request_id': 'req-cfc0f711-55ce-4653-84e7-f30817d74800'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.862355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e133e880fa4fec82c0b928ce88398a', 'request_id': 'req-cfc0f711-55ce-4653-84e7-f30817d74800'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.875737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] The token cache is being invalidate because project c6e133e880fa4fec82c0b928ce88398a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:18.876026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.876703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-cfc0f711-55ce-4653-84e7-f30817d74800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:18.878279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1168/2277] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:18 2022] DELETE /identity/v3/projects/c6e133e880fa4fec82c0b928ce88398a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:18.883644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:18.884116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:18.884209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:18.904508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:18.905827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:18.968926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1110/2278] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:18.977810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:18.978224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:18.978675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.008661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:19.010114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:19.018670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1169/2279] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:19.022646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.033009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4abd05-d1f2-4970-9742-670f81e4701f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.038330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.038946 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.039222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.039665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.040531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:58:19.040835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.042483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.056785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1111/2280] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:58:19.061298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.071211 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9c4c7-5ba5-444d-8467-a792b3a906f9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.076297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.077237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.077237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.077475 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.078092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.080221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.124926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1170/2281] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:58:19 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:58:19.126629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.138314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e585a690-ef8e-48fa-9253-7823d1c310b7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.169048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:19.218540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.219403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.219847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.220186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.220998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.223088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.260209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1112/2282] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:58:19 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:19.261730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.273416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692cdea4-ab04-41d5-93ea-896e8417e3b8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.279396 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.280013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.280288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.280592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.281231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.282819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.293740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1171/2283] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:19.297767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.308346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edec5cf0-efa2-41ce-a1b8-647d1d618a5d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.313028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.313622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.313898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.314165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.314806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.316379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d1977-4a2a-4b36-82d5-bc1df19ad38c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.326970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1113/2284] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:58:19.331309 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.342326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0631b620-6523-49da-af0b-6d5788be96fd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.348093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.348825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.349109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.349394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] PATH_INFO: `/v3/projects/dcd35417e3234dcfbb447d40cb51de9f/users/4d80329bb2ec40dcbbad517406687e80/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.367201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd35417e3234dcfbb447d40cb51de9f, user_id=4d80329bb2ec40dcbbad517406687e80, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.370002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.390454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1172/2285] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:58:19 2022] PUT /identity/v3/projects/dcd35417e3234dcfbb447d40cb51de9f/users/4d80329bb2ec40dcbbad517406687e80/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:58:19.401268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.401993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.402252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.435031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] MFA Rules not processed for user `4d80329bb2ec40dcbbad517406687e80`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:19.436378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:19.517378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1114/2286] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:19.530001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.533486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:19.658814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529ad4a-c7c5-4165-91a4-3e9b67bdccac admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.665076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.666904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.667234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.667595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.716300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.719792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ceac7-0dd7-41ac-aa4e-efcd707e84a2 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.749226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1173/2287] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:19.799642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:19.943545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738c364-2257-43bc-b5fb-b57f315e2e1e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:19.951021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:19.951596 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:19.951890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:19.952149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] PATH_INFO: `/v3/users/4d80329bb2ec40dcbbad517406687e80` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:19.953404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d80329bb2ec40dcbbad517406687e80)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:19.955353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:19.991667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:20.007737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d80329bb2ec40dcbbad517406687e80'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.008456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d80329bb2ec40dcbbad517406687e80'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.016653 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d80329bb2ec40dcbbad517406687e80'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.024106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d80329bb2ec40dcbbad517406687e80'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.036141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d80329bb2ec40dcbbad517406687e80'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.044568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1115/2288] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:19 2022] DELETE /identity/v3/users/4d80329bb2ec40dcbbad517406687e80 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:20.047576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1086-c727-433f-8f3b-379153675794 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:20.047950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1086-c727-433f-8f3b-379153675794 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:20.048440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb1086-c727-433f-8f3b-379153675794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:20.068384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-29fb1086-c727-433f-8f3b-379153675794 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:20.069605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-29fb1086-c727-433f-8f3b-379153675794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:20.079337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:20.135252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1174/2289] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:20.145149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:20.146756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:20.205408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4384d289-f618-4ee3-bb55-20354bc8e60f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:20.209535 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:20.210143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:20.210438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:20.210691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:20.220339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:20.221809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:20.238473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1116/2290] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:20.816346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1086-c727-433f-8f3b-379153675794 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:20.817842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-29fb1086-c727-433f-8f3b-379153675794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:20.837333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb1086-c727-433f-8f3b-379153675794 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:20.842605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:20.843472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:20.843472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:20.843828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] PATH_INFO: `/v3/projects/dcd35417e3234dcfbb447d40cb51de9f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:20.845029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd35417e3234dcfbb447d40cb51de9f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:20.846962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:20.982667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd35417e3234dcfbb447d40cb51de9f', 'request_id': 'req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:20.990610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd35417e3234dcfbb447d40cb51de9f', 'request_id': 'req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:21.007902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd35417e3234dcfbb447d40cb51de9f', 'request_id': 'req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:21.028676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] The token cache is being invalidate because project dcd35417e3234dcfbb447d40cb51de9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:21.029234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:21.029981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:21.031826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1175/2291] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:20 2022] DELETE /identity/v3/projects/dcd35417e3234dcfbb447d40cb51de9f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:27.964315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:27.965848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:27.981582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8dc44f-2453-4b4e-925d-02f19d93dfc3 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:28.039345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:28.039978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:28.040253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:28.040553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] PATH_INFO: `/v3/users/e4677ee28ff84162befec0f1781c3555` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:28.041682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4677ee28ff84162befec0f1781c3555)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:28.043595 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:28.101024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4677ee28ff84162befec0f1781c3555'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.101781 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4677ee28ff84162befec0f1781c3555'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.106289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:28.111523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4677ee28ff84162befec0f1781c3555'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.121000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4677ee28ff84162befec0f1781c3555'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.135243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4677ee28ff84162befec0f1781c3555'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.141495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1117/2292] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:27 2022] DELETE /identity/v3/users/e4677ee28ff84162befec0f1781c3555 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:28.316750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:28.318245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:28.332881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab6afbc-51d3-4400-a67c-a40ed82e46f5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:28.403390 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:28.404569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:28.405160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:28.405610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] PATH_INFO: `/v3/projects/6960abba18204e27afc97f851ddd5413` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:28.407653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6960abba18204e27afc97f851ddd5413)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:28.410975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:28.455705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:28.462355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6960abba18204e27afc97f851ddd5413', 'request_id': 'req-50d807f9-c974-4a99-aa98-c2cf4f04772a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.473101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6960abba18204e27afc97f851ddd5413', 'request_id': 'req-50d807f9-c974-4a99-aa98-c2cf4f04772a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.482226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6960abba18204e27afc97f851ddd5413', 'request_id': 'req-50d807f9-c974-4a99-aa98-c2cf4f04772a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.495087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] The token cache is being invalidate because project 6960abba18204e27afc97f851ddd5413 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:28.495381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.496796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.498796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1176/2293] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:28 2022] DELETE /identity/v3/projects/6960abba18204e27afc97f851ddd5413 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:28.503650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:28.505557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:28.519530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39687c3a-f46a-4d6b-91d1-6d150c083c69 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:28.579910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:28.580577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:28.580856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:28.581130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] PATH_INFO: `/v3/users/abb56d732ed84776b0eb8c8965b03537` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:28.582244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb56d732ed84776b0eb8c8965b03537)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:28.584153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:28.630140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb56d732ed84776b0eb8c8965b03537'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.630857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb56d732ed84776b0eb8c8965b03537'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.638918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb56d732ed84776b0eb8c8965b03537'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.646260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb56d732ed84776b0eb8c8965b03537'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.657576 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d430407b-b956-4107-9eb0-21bcef3e2d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb56d732ed84776b0eb8c8965b03537'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.663461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1118/2294] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:28 2022] DELETE /identity/v3/users/abb56d732ed84776b0eb8c8965b03537 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:28.838478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:28.840014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:28.853857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d807f9-c974-4a99-aa98-c2cf4f04772a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:28.913477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:28.914149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:28.914432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:28.914707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] PATH_INFO: `/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:28.915830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] RBAC: Authorizing `identity:delete_project(project_id=896d1ea8dfc345d59fe19ce858b0f6d6)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:28.917791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:28.965530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '896d1ea8dfc345d59fe19ce858b0f6d6', 'request_id': 'req-7d26aefb-922b-4416-aed7-b4bd41fc916f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.971420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '896d1ea8dfc345d59fe19ce858b0f6d6', 'request_id': 'req-7d26aefb-922b-4416-aed7-b4bd41fc916f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.981771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '896d1ea8dfc345d59fe19ce858b0f6d6', 'request_id': 'req-7d26aefb-922b-4416-aed7-b4bd41fc916f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.994173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] The token cache is being invalidate because project 896d1ea8dfc345d59fe19ce858b0f6d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:28.994463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.995143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7d26aefb-922b-4416-aed7-b4bd41fc916f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:28.996694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1177/2295] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:28 2022] DELETE /identity/v3/projects/896d1ea8dfc345d59fe19ce858b0f6d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:29.001496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.002080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.002080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.021795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:29.023064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:29.068155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:29.091335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1119/2296] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:29.099305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.099686 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.100048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.121165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:29.122343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:29.130749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1178/2297] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:29.135209 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.145814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51aa22-f6a9-4f12-88b6-365ee3f90f26 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.151220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.151847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.152152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.152450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.153101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:58:29.153404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.154999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.166966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1120/2298] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:58:29.171245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.180523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a0b8a-e638-4056-a397-18153a34fcf4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.185239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.185837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.186118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.186391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.187023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.188997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.217246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1179/2299] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:58:29 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:29.221962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.232786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab636c5-c309-4a3b-ab8c-877b967b4d38 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.289439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.290046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.290320 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.290586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.291198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.293138 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.315914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1121/2300] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:58:29 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:29.319906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.332812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5972ef-1f53-49ce-b485-50de8bcea4fc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.340252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.340820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.341098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.341364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.342251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.343593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.355370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1180/2301] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:58:29.359455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.370899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624085bb-1844-4f57-8432-d68e145a0684 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.376557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.377245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.377589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.383916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.383916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.383916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca8fc1-7a0e-45f0-9469-1264882154ed admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.398341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1122/2302] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:29.400660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.418242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9cf2f-269e-4ee1-9949-8948312e33e7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.424627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.425629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.426293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.426720 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] PATH_INFO: `/v3/projects/c88069fbe1134cf290179839d6ed02a1/users/5c5060edbf4d43c09825279de13df9e1/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.448667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c88069fbe1134cf290179839d6ed02a1, user_id=5c5060edbf4d43c09825279de13df9e1, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.452041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.455672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:29.469979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1181/2303] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:58:29 2022] PUT /identity/v3/projects/c88069fbe1134cf290179839d6ed02a1/users/5c5060edbf4d43c09825279de13df9e1/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:29.482454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1459b-b9d1-4a49-9636-daefd4848d3c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.482809 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1459b-b9d1-4a49-9636-daefd4848d3c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.483153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1459b-b9d1-4a49-9636-daefd4848d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.515438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-71e1459b-b9d1-4a49-9636-daefd4848d3c None None] MFA Rules not processed for user `5c5060edbf4d43c09825279de13df9e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:29.516684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-71e1459b-b9d1-4a49-9636-daefd4848d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:29.598184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1123/2304] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:29.606745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:29.609455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:29.677324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc006e58-45c0-4dc1-bd2e-e2eb42228a5e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:29.681793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:29.681793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:29.682064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:29.682220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:29.692082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:29.693598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:29.703952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1182/2305] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:30.495615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63721b-02ce-43b8-a197-59042a821555 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:30.496174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63721b-02ce-43b8-a197-59042a821555 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:30.496174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63721b-02ce-43b8-a197-59042a821555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:30.515805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2f63721b-02ce-43b8-a197-59042a821555 None None] MFA Rules not processed for user `616ea15bf7ae4ab6afa632b00f07ec17`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:30.517063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2f63721b-02ce-43b8-a197-59042a821555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:30.556970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:30.574778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1124/2306] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:33.012520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:33.080303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17773b62-b7c9-49bd-a586-8459696f12b1 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:33.085847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:33.086486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:33.086765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:33.087040 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] PATH_INFO: `/v3/users/5c5060edbf4d43c09825279de13df9e1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:33.088160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c5060edbf4d43c09825279de13df9e1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:33.090158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:33.139946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c5060edbf4d43c09825279de13df9e1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.149664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c5060edbf4d43c09825279de13df9e1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.157745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c5060edbf4d43c09825279de13df9e1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.158435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c5060edbf4d43c09825279de13df9e1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.175391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c5060edbf4d43c09825279de13df9e1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.181970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1183/2307] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:58:33 2022] DELETE /identity/v3/users/5c5060edbf4d43c09825279de13df9e1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:33.186410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:33.186410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:33.187078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:33.206290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:33.207483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:33.311970 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1125/2308] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:33.327710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:33.331026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:33.357861 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:33.402941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422ea24-af33-4aab-8809-d6fb0381b490 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:33.409015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:33.409015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:33.409015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:33.409015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:33.418675 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:33.420124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7e7f01-3bf1-4793-a7f7-89b686b4c44a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:33.430066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1184/2309] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:33.766723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:33.768763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:33.791556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f75fe5-da03-4528-af70-e623a922cac6 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:33.801032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:33.804805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:33.805640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:33.806227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] PATH_INFO: `/v3/projects/c88069fbe1134cf290179839d6ed02a1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:33.808165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c88069fbe1134cf290179839d6ed02a1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:33.810692 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:33.931229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c88069fbe1134cf290179839d6ed02a1', 'request_id': 'req-f09fc565-09b6-466d-bd18-618fcc729dcc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.938793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c88069fbe1134cf290179839d6ed02a1', 'request_id': 'req-f09fc565-09b6-466d-bd18-618fcc729dcc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.954097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c88069fbe1134cf290179839d6ed02a1', 'request_id': 'req-f09fc565-09b6-466d-bd18-618fcc729dcc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.982199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] The token cache is being invalidate because project c88069fbe1134cf290179839d6ed02a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:58:33.982786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.984252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f09fc565-09b6-466d-bd18-618fcc729dcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:58:33.988127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1126/2310] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:58:33 2022] DELETE /identity/v3/projects/c88069fbe1134cf290179839d6ed02a1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:58:33.995034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:33.995324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:33.995611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.034041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:34.035455 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:34.148645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1185/2311] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:34.157338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.157620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.157960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.184325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:34.185003 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:34.201049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1127/2312] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:34.201989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.213904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0e1801-709d-44b9-bd91-babc0e5978fa None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.218855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.219657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.219970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.220334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.221584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:58:34.221584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.223760 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.242744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1186/2313] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:58:34.245790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.256735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d12051-b632-4479-9b6c-c2bc31390d2a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.261995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.262915 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.263611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.264087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.264947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.267353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.300780 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1128/2314] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:58:34 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:34.302249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.314816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5cf4f0-5036-4cc0-ba58-c6c380478c61 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.409517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.409804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.410226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.410751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.413669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.415929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.463484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1187/2315] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:58:34 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:58:34.464717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.487228 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c2c0b-f1f1-4742-98dd-1e30e14532bd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.494349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.495139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.495477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.495817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.496579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.498273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.512625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1129/2316] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:34.513979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.528695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb2e62-9432-47aa-aa5c-5b79e211f9aa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.534174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.534797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.535697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.535982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.536683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.538895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8b74-b0e2-4757-947b-e570629a2867 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.550771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1188/2317] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:58:34.554895 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.565260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39357433-8211-4704-b3fb-0095b122c094 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.569988 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.570639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.570912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.571183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] PATH_INFO: `/v3/projects/ce44367a42554d9d90b4fdd8f309c38b/users/661092b4e45842a798b2a6a26145ab01/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.586991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce44367a42554d9d90b4fdd8f309c38b, user_id=661092b4e45842a798b2a6a26145ab01, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.590018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.605492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1130/2318] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:58:34 2022] PUT /identity/v3/projects/ce44367a42554d9d90b4fdd8f309c38b/users/661092b4e45842a798b2a6a26145ab01/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:58:34.616815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81995e-d1ef-4d56-9823-5c857058c1f0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.617115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81995e-d1ef-4d56-9823-5c857058c1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.617381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81995e-d1ef-4d56-9823-5c857058c1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.649793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-bc81995e-d1ef-4d56-9823-5c857058c1f0 None None] MFA Rules not processed for user `661092b4e45842a798b2a6a26145ab01`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:34.651053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-bc81995e-d1ef-4d56-9823-5c857058c1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:34.664724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:34.717635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1189/2319] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:34.729901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:34.731636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:34.744281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:34.809469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6ca656-f0c3-447a-bc87-012c80069727 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:34.813142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:34.813741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:34.814015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:34.814281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:34.822867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:34.824279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:34.832900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1131/2320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:44.714987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=20 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:44.829006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=31 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:52.970652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373f3c0-a5b3-4118-9848-ad5ba60d247e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:52.971222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373f3c0-a5b3-4118-9848-ad5ba60d247e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:52.971222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373f3c0-a5b3-4118-9848-ad5ba60d247e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:52.994307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9373f3c0-a5b3-4118-9848-ad5ba60d247e None None] MFA Rules not processed for user `7803d5b00079428ba28d956cec4085f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:52.995543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9373f3c0-a5b3-4118-9848-ad5ba60d247e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:53.061121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1190/2321] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:58:52 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:03.054433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=25 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:05.066896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:05.173715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1868d-e960-4abd-a6ec-a31135d341a4 service glance] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:05.179768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:05.180708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.181173 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.181644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] PATH_INFO: `/v3/users/661092b4e45842a798b2a6a26145ab01` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.182987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661092b4e45842a798b2a6a26145ab01)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:05.184937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:05.238642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661092b4e45842a798b2a6a26145ab01'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.239346 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661092b4e45842a798b2a6a26145ab01'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.247434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661092b4e45842a798b2a6a26145ab01'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.256483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661092b4e45842a798b2a6a26145ab01'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.270974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661092b4e45842a798b2a6a26145ab01'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.277368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1132/2322] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:59:05 2022] DELETE /identity/v3/users/661092b4e45842a798b2a6a26145ab01 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:05.281643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.282143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.282143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.311144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:05.313483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:05.403359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1191/2323] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:05.413958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:05.416289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:05.479835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b19c4-0aca-4344-9959-5c824550a1e6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:05.483708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:05.484326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.484644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.484918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.494482 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:05.495912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014449b7-e887-4f10-81a3-029d78308b5d service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:05.506458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1133/2324] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:05.798777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:05.800693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:05.829638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf721d-3a0d-4d91-8a52-bba6352b63a6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:05.835697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:05.836787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.837139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.837605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] PATH_INFO: `/v3/projects/ce44367a42554d9d90b4fdd8f309c38b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.839550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce44367a42554d9d90b4fdd8f309c38b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:05.842029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:05.900169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce44367a42554d9d90b4fdd8f309c38b', 'request_id': 'req-188c0e57-7b66-4dac-825e-aa50a67ea9dc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.906680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce44367a42554d9d90b4fdd8f309c38b', 'request_id': 'req-188c0e57-7b66-4dac-825e-aa50a67ea9dc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.914882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce44367a42554d9d90b4fdd8f309c38b', 'request_id': 'req-188c0e57-7b66-4dac-825e-aa50a67ea9dc'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.929724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] The token cache is being invalidate because project ce44367a42554d9d90b4fdd8f309c38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:59:05.929906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.930733 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-188c0e57-7b66-4dac-825e-aa50a67ea9dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:05.935350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1192/2325] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:59:05 2022] DELETE /identity/v3/projects/ce44367a42554d9d90b4fdd8f309c38b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:05.937062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:05.937345 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:05.937617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:05.961755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:05.962976 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:05.981877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:06.028873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1134/2326] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:06.037681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.038032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.038368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.059016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:06.060248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:06.069317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1193/2327] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:06.074150 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.083438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308905c9-0326-4eee-b386-5a2b3947badd None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.088471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.089084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.089365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.089640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.090294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:06.090608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.092252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.104336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1135/2328] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:06.109300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.119204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100f1e57-34b0-4624-87e4-ef5a6f2b5878 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.123922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.124547 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.124826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.125096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.125719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.127651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.160888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1194/2329] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:59:06 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:06.165033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.179479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114c41-71fa-4713-9784-5e67bd3ce36f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.261807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.262434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.262718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.262997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.263627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.265586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.288355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1136/2330] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:59:06 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:06.292009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.303093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4716a037-71a4-4961-927a-e8dac0eb27cc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.308006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.308653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.308932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.309201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.309839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.311426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.321808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1195/2331] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:59:06.325974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.336196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fd5ce7-febe-41e9-b1fc-2a1768ad5502 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.341280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.341891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.342170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.342442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.343086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.344745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069aea1-1273-4d32-820b-2d5018086909 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.356803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1137/2332] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:59:06.360827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.371539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c5c0a2-c31f-4b7d-9243-9006a76b86f0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.376283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.376969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.377280 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.377558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] PATH_INFO: `/v3/projects/75560352ec114d2b8f3df68cb68aba73/users/7b05eeff4e1043e09ff5e2a03c9d9c56/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.392523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75560352ec114d2b8f3df68cb68aba73, user_id=7b05eeff4e1043e09ff5e2a03c9d9c56, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.395250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.413605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1196/2333] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:59:06 2022] PUT /identity/v3/projects/75560352ec114d2b8f3df68cb68aba73/users/7b05eeff4e1043e09ff5e2a03c9d9c56/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:06.491424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d6a3c-159a-488f-bcf4-ecefe7b7fe4b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.491703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d6a3c-159a-488f-bcf4-ecefe7b7fe4b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.491972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d6a3c-159a-488f-bcf4-ecefe7b7fe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.520564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-026d6a3c-159a-488f-bcf4-ecefe7b7fe4b None None] MFA Rules not processed for user `7b05eeff4e1043e09ff5e2a03c9d9c56`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:06.521793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-026d6a3c-159a-488f-bcf4-ecefe7b7fe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:06.586955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1138/2334] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:59:06.598588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:06.600289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:06.623107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:06.663153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ffee1-54fd-462c-a5b2-8137c2b4ea93 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:06.666903 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:06.667514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:06.667795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:06.668071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:06.676359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:06.677822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:06.686546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1197/2335] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:07.416963 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.417504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.417504 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.442904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:07.444102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:07.462418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:07.514151 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1139/2336] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 02:59:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:07.585148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:07.586730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:07.679315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a04f3-dc87-49bf-95a1-2f2c1b15b59a service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:07.684737 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:07.685351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:07.685628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:07.685901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:07.695965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:07.697620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9191d4c7-5747-49b7-b88f-f6a17c335e05 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:07.706931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1198/2337] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 02:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:59:09.139192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:09.140714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:09.208965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99a7ac-52b4-430b-abad-b6ca32b83a28 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:09.216128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:09.217704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:09.218875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:09.219660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:09.223226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:09.332029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:09.334077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:09.354009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1140/2338] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:17.703014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=49 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:19.342202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=67 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:30.300365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.300907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.301012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.320766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:30.322103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:30.329567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1199/2339] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 02:59:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:30.343633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:30.356364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4976c0-7765-403e-8ea0-756c7788154f service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:30.361903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:30.363048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:30.363330 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:30.363606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:30.372469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:30.374071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:30.384875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1141/2340] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 02:59:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:59:32.374340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.377562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:32.468970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfaaf63-0fdf-4256-9b64-0e7db2384d87 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.473664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.474298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.474579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.474848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] PATH_INFO: `/v3/users/616ea15bf7ae4ab6afa632b00f07ec17` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.475982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616ea15bf7ae4ab6afa632b00f07ec17)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.478228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.528225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616ea15bf7ae4ab6afa632b00f07ec17'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.539187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616ea15bf7ae4ab6afa632b00f07ec17'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.551609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616ea15bf7ae4ab6afa632b00f07ec17'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.552342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616ea15bf7ae4ab6afa632b00f07ec17'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.565194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-bfbf320f-4e56-4c90-988b-ae76da392d26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616ea15bf7ae4ab6afa632b00f07ec17'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.571300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1200/2341] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:59:32 2022] DELETE /identity/v3/users/616ea15bf7ae4ab6afa632b00f07ec17 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:32.765018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:32.781903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b6326-4499-4d72-9ec7-d5dd4bd058a8 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:32.858368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:32.859122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.859410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.859684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] PATH_INFO: `/v3/projects/dff87872d4834c03bd689b9a6fa4579e` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.860848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff87872d4834c03bd689b9a6fa4579e)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:32.863349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:32.914721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff87872d4834c03bd689b9a6fa4579e', 'request_id': 'req-9743cf32-fc06-4c01-a815-79ea324bb120'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.920859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff87872d4834c03bd689b9a6fa4579e', 'request_id': 'req-9743cf32-fc06-4c01-a815-79ea324bb120'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.930566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff87872d4834c03bd689b9a6fa4579e', 'request_id': 'req-9743cf32-fc06-4c01-a815-79ea324bb120'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.946733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] The token cache is being invalidate because project dff87872d4834c03bd689b9a6fa4579e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:59:32.947028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.947680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9743cf32-fc06-4c01-a815-79ea324bb120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:32.949204 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1142/2342] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:59:32 2022] DELETE /identity/v3/projects/dff87872d4834c03bd689b9a6fa4579e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:59:32.954012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:32.954299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:32.954606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:32.975144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:32.976336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:33.041633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1201/2343] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:33.049357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.049642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.049914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.070213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:33.071408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:33.079255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1143/2344] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:33.083978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.093469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954d3b2-3860-4827-a547-b0b4f600e8a8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.098670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.099283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.099566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.099842 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.100540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:59:33.100888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.102724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.115722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.119099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1202/2345] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:59:33.124588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.137719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e2bc0-4e21-456d-aef4-f0fcaf35be45 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.142249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.142842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.143651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.143918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.144573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.146488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.176844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1144/2346] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 02:59:33 2022] POST /identity/v3/projects => generated 397 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:59:33.180684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.190933 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be123a-31be-4c47-bf1d-239a2503b85e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.261372 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.261984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.262264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.262538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.263172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.265130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.286484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1203/2347] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 02:59:33 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:59:33.290572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.301605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9038166-3210-4831-a736-7b88cdb2d7b0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.306530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.307137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.307420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.307690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.308335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.309964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.322470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1145/2348] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:59:33.326900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.337115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cdffb-bafd-412d-b118-074a2a95b5b1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.341803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.342413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.342909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.343129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.343829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.345307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38251787-23af-4b31-94a8-cb7601dbabcf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.365070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1204/2349] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:59:33.369336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.379553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774cadc-d545-466d-a4ee-57b25477c6d3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.384223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.384923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.385729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.385729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] PATH_INFO: `/v3/projects/de25f3dc02cf484189c28024acf984e3/users/66b80fb432154ce89af2c69c0c52b963/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.401536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de25f3dc02cf484189c28024acf984e3, user_id=66b80fb432154ce89af2c69c0c52b963, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.404146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.419931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1146/2350] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 02:59:33 2022] PUT /identity/v3/projects/de25f3dc02cf484189c28024acf984e3/users/66b80fb432154ce89af2c69c0c52b963/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:33.434295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.434295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.435237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.498888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] MFA Rules not processed for user `66b80fb432154ce89af2c69c0c52b963`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:33.500115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:33.586589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1205/2351] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:33.598611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:33.602139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:33.618397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:33.699602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20364795-8a29-4a12-afe1-c6523d04a3c8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:33.703275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:33.703892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:33.704168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:33.704455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:33.717896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:33.719783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c15db52-53c9-442f-9704-d8eba33eb340 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:33.730379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1147/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:40.962317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.025085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3173ae0-e1ac-4544-aa19-adb6fc7f5762 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.029653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.030287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.030570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.030846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] PATH_INFO: `/v3/users/66b80fb432154ce89af2c69c0c52b963` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.031957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b80fb432154ce89af2c69c0c52b963)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.033926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.045333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:41.082597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b80fb432154ce89af2c69c0c52b963'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.089594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b80fb432154ce89af2c69c0c52b963'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.096420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b80fb432154ce89af2c69c0c52b963'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.097070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b80fb432154ce89af2c69c0c52b963'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.108831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b80fb432154ce89af2c69c0c52b963'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.115213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1206/2353] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:59:40 2022] DELETE /identity/v3/users/66b80fb432154ce89af2c69c0c52b963 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:41.119817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.120273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.120382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.140372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:41.141819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:41.199703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1148/2354] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:59:41.209622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.211164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:41.267756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccf4f5-9b48-47ae-82f6-102f1f7aafce admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.271381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.271982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.272262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.272567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.282014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.283464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.292784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1207/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:41.730905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:41.732455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:41.745358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1220f-32c4-45ad-a96a-199520f10519 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:41.750176 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:41.750858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:41.751136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:41.751409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] PATH_INFO: `/v3/projects/de25f3dc02cf484189c28024acf984e3` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:41.752630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de25f3dc02cf484189c28024acf984e3)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:41.754566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:41.801996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de25f3dc02cf484189c28024acf984e3', 'request_id': 'req-0473030b-2c4d-4695-b108-9956c56a3019'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.809112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de25f3dc02cf484189c28024acf984e3', 'request_id': 'req-0473030b-2c4d-4695-b108-9956c56a3019'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.817716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de25f3dc02cf484189c28024acf984e3', 'request_id': 'req-0473030b-2c4d-4695-b108-9956c56a3019'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.829019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] The token cache is being invalidate because project de25f3dc02cf484189c28024acf984e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:59:41.829309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.829980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0473030b-2c4d-4695-b108-9956c56a3019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:41.831470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1149/2356] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:59:41 2022] DELETE /identity/v3/projects/de25f3dc02cf484189c28024acf984e3 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:51.288642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=10,keystone:SELECT=48,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:51.825947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:54.122004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.123435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.136604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc573db-3f00-43f5-a4d9-1261fbc829ce service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.191768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.192399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.192703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.192976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] PATH_INFO: `/v3/users/7b05eeff4e1043e09ff5e2a03c9d9c56` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.194084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b05eeff4e1043e09ff5e2a03c9d9c56)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.195993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.241118 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b05eeff4e1043e09ff5e2a03c9d9c56'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.248544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b05eeff4e1043e09ff5e2a03c9d9c56'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.256337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b05eeff4e1043e09ff5e2a03c9d9c56'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.257008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b05eeff4e1043e09ff5e2a03c9d9c56'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.268594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b05eeff4e1043e09ff5e2a03c9d9c56'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.274757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1208/2357] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 02:59:54 2022] DELETE /identity/v3/users/7b05eeff4e1043e09ff5e2a03c9d9c56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:59:54.279226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.279676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.279767 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.298934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:59:54.300644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.360784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1150/2358] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 02:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:59:54.371007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.372476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.434038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d18c8-1feb-4861-acca-ad51745c299e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.442476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.443084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.443364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.443639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.452805 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.454233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3606628d-08e9-4f3e-8afe-dfe492b615ba service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.463548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1209/2359] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 02:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:54.729372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:59:54.730828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:59:54.743721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc2803-8377-4406-b79a-233e6c67a560 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:59:54.748447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:59:54.749121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:59:54.749401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:59:54.749669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] PATH_INFO: `/v3/projects/75560352ec114d2b8f3df68cb68aba73` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:59:54.750888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] RBAC: Authorizing `identity:delete_project(project_id=75560352ec114d2b8f3df68cb68aba73)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:59:54.753378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:59:54.802284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75560352ec114d2b8f3df68cb68aba73', 'request_id': 'req-c785b8ef-ff3e-4647-accf-a03cb5fa31da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.807675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75560352ec114d2b8f3df68cb68aba73', 'request_id': 'req-c785b8ef-ff3e-4647-accf-a03cb5fa31da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.814688 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75560352ec114d2b8f3df68cb68aba73', 'request_id': 'req-c785b8ef-ff3e-4647-accf-a03cb5fa31da'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.825430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] The token cache is being invalidate because project 75560352ec114d2b8f3df68cb68aba73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:59:54.825713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.826335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:59:54.827794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1151/2360] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 02:59:54 2022] DELETE /identity/v3/projects/75560352ec114d2b8f3df68cb68aba73 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:00.793485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.794013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.794013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.814256 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:00.816502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:00.834364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:00.887570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1210/2361] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:00.900868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:00.902752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:00.976030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c785b8ef-ff3e-4647-accf-a03cb5fa31da admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:00.981796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:00.982235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:00.983170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:00.983551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:00.993066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:00.994641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414b2af-f55c-4049-944b-4f838b6971de service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:01.004074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1152/2362] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:00:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:00:10.887791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=15 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:11.000028 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:15.564961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:15.566410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:15.642304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f2930-c68d-4a24-80bc-6954993442e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:15.647554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:15.648185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:15.648496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:15.648768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:15.650476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:15.662667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:15.664249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5d55-04dd-4e0f-9bfc-c3986ce73c93 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:15.675505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1211/2363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:17.362490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.362971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.363110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.364939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1153/2364] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:17.371110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd660b-5800-4326-ab2f-4d951dab54a2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.371617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd660b-5800-4326-ab2f-4d951dab54a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.371768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd660b-5800-4326-ab2f-4d951dab54a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.394049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8ccd660b-5800-4326-ab2f-4d951dab54a2 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:17.395310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8ccd660b-5800-4326-ab2f-4d951dab54a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.465183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1212/2365] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:17.476994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.478769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.538870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3228b736-111b-49ab-ae22-9fc2df649acc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.542826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.543425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.543707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.543981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.555097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.556571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bd39d-0f68-45d2-9ff1-c14b594813a9 service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.567699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1154/2366] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:17.635229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.635513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.635788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.637155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1213/2367] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:17.641974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10229d7-ffac-4129-a1a2-d79c57b64a7a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.642258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10229d7-ffac-4129-a1a2-d79c57b64a7a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.642529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10229d7-ffac-4129-a1a2-d79c57b64a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.661621 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b10229d7-ffac-4129-a1a2-d79c57b64a7a None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:17.662818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b10229d7-ffac-4129-a1a2-d79c57b64a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.714142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1155/2368] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:00:17.726261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.727997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.741661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44dfd2b-32f0-49dd-b968-14a03897da56 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.745217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.745809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.746090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.746363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.754186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.755600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058acf49-efbc-4fd4-8b35-d742d13ce955 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.763347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1214/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:17.847025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e854-b9e9-4b04-9653-fdbdc79c79ba None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.847510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e854-b9e9-4b04-9653-fdbdc79c79ba None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.847930 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89e854-b9e9-4b04-9653-fdbdc79c79ba None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.849843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1156/2370] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:00:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:17.855381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26bb-d9cb-486d-89e2-9d2cdc6aad00 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.855747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26bb-d9cb-486d-89e2-9d2cdc6aad00 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.856026 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a26bb-d9cb-486d-89e2-9d2cdc6aad00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.875927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0c7a26bb-d9cb-486d-89e2-9d2cdc6aad00 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:17.877176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0c7a26bb-d9cb-486d-89e2-9d2cdc6aad00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:17.886421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1215/2371] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:00:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:17.896579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e854-b9e9-4b04-9653-fdbdc79c79ba None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:17.907861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89e854-b9e9-4b04-9653-fdbdc79c79ba None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:17.911676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:17.912437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:17.912723 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:17.912998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:17.923856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:17.925316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:17.938271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1157/2372] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:20.287856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3ac7-09f6-42cc-b1bc-28775e07521f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.288324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3ac7-09f6-42cc-b1bc-28775e07521f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.288453 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3ac7-09f6-42cc-b1bc-28775e07521f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.307124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-d0fd3ac7-09f6-42cc-b1bc-28775e07521f None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:20.308327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d0fd3ac7-09f6-42cc-b1bc-28775e07521f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:20.316092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1216/2373] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:20.327680 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:20.339634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89b8764-08e2-4847-9211-12e9483a766e service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:20.344678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:20.345325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:20.345553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:20.345828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:20.354394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:20.355997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f607c5fe-f9b5-4f53-ac9d-499f269a4403 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:20.364015 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1158/2374] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:00:30.303301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=75 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.360864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=61 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.184286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.185239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.185239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.205175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] MFA Rules not processed for user `9986a3dc2450420abf8c260c4c8d109b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:43.206407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:43.260009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1217/2375] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.573001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb80d2-2163-4ffc-a350-fe7f748481db None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.573546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb80d2-2163-4ffc-a350-fe7f748481db None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.573546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb80d2-2163-4ffc-a350-fe7f748481db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.594215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-44bb80d2-2163-4ffc-a350-fe7f748481db None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.595553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-44bb80d2-2163-4ffc-a350-fe7f748481db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.610805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1159/2376] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.623695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.636273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de826a9-e86f-448f-a7f9-51eb563d833d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.641528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.642193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.642483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.642783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.651997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:46.653674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:46.663526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1218/2377] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:00:56.588468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.659774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=31 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.754960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.755474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.755572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.773843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] MFA Rules not processed for user `7803d5b00079428ba28d956cec4085f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.775032 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.829222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1160/2378] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:27.822366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=25 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:39.439194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:39.448864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9952f-784d-4730-8a78-640ae2610e2c service swift] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:39.452538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:39.453128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:39.453403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:39.453672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:39.455368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:39.468579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:39.469982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e52cf7-3bf4-46af-8d9b-5bcb9527c70b service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:39.480859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1219/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:40.661156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:40.671652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43c2dc-6bb1-43ce-8caf-c15df680d65f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:40.675205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:40.675807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.676084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.676356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.678157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:40.692158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:40.693637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:40.705047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1161/2380] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:49.476117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=6 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:50.699953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:04.201062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.201603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.201603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.225757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] MFA Rules not processed for user `7bb057384cf94a249c95fce8f7eff4e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:04.226948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.280194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1220/2381] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:02:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:04.584452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.593481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4c4f4-f9c7-4039-9888-e0ab8fbba8fe service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.597029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.597871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.598144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.598409 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.600092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.610049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.611445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.619501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1162/2382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:04.911803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.913242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.932641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.934130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e072594-a11c-4930-9b45-ef1e7ea14928 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.939703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.940315 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.940619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.940893 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.942586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.944945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec016770-869f-4850-9ad8-84af493811a8 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.950823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.951423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.951701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.951972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.953681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.953860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.955527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.965207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1221/2383] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:04 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:04.966009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.967590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4eb224-9354-46b5-a767-526d2db3ef8e service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.978450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1163/2384] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:02:06.922657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:06.932131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e597c77-7462-4f1c-a645-bf2e1ee1b84b service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.936990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.937591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.937872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.938152 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.939941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:06.949746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.951182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44541dbc-2ed7-4194-a578-ebbccfc5b0be service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.959272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1222/2385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:14.973819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=12 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:16.956095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=37 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:30.454281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3408c-0ee3-474c-8018-ade9df661c5f None None] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.455043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3408c-0ee3-474c-8018-ade9df661c5f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.455043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3408c-0ee3-474c-8018-ade9df661c5f None None] PATH_INFO: `/` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.456610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1164/2386] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:30.463044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62337-ff0e-413b-815e-2f78852a2fc4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.463576 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62337-ff0e-413b-815e-2f78852a2fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.463674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec62337-ff0e-413b-815e-2f78852a2fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.485368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-cec62337-ff0e-413b-815e-2f78852a2fc4 None None] MFA Rules not processed for user `868cf3d873a349d1bc43e309a9a6acc2`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:30.486598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-cec62337-ff0e-413b-815e-2f78852a2fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.495448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1223/2387] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:30.508957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3408c-0ee3-474c-8018-ade9df661c5f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:30.520163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3408c-0ee3-474c-8018-ade9df661c5f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:30.523849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:30.524489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.524772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.525046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.533308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:30.534745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cada905-9290-44ed-a0f2-b93b3c9f1062 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:30.543812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1165/2388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:30.646018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.646296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.646628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.647888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1224/2389] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:30.654227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.654593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.655026 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.680547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:30.681687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.689260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:30.691264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.692139 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1166/2390] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:30.703134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:30.704555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.718647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6937e-0590-481e-b6f8-bbe19de415e2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:30.723066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:30.723669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.723940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.724202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.735439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:30.736927 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:30.749520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1167/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:02:30.758402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeccc33f-2b61-4811-bd92-2afef6c6abd2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:30.762327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:30.762951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.763231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.763554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.765381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.777624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:30.779070 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:30.788759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1225/2392] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:02:33.734278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:33.736648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:33.753043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a68167-891f-46f4-9b42-531c7d8f6e89 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:33.758936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:33.759800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:33.760254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:33.761274 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:33.765048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:33.778683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:33.780488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:33.803458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1168/2393] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:34.433554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:34.450405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a431af7-2457-4237-a21f-386b38587494 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:34.457972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:34.458706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:34.459052 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:34.459389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:34.461301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:34.475122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:34.476770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:34.489283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1226/2394] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:43.788704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=21 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:44.484136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=35 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:46.300663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.311678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579fc4b-11a3-4285-9cab-da1560f4295b service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.317457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.318065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.318349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.318625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.320893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.333218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.334834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e081b-24a0-42d1-8c38-55595d37892a service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.346466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1169/2395] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:47.885550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:47.886955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:47.898782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6715f-6b65-4b01-8c2f-73c231110608 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:47.902927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:47.903528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:47.903814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:47.904089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:47.905787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:47.963627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:47.965108 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:47.974353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1227/2396] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:53.407446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78565-8b11-4f13-ae9f-a5fd77deb6f5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.408356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78565-8b11-4f13-ae9f-a5fd77deb6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.408654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb78565-8b11-4f13-ae9f-a5fd77deb6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.427546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9cb78565-8b11-4f13-ae9f-a5fd77deb6f5 None None] MFA Rules not processed for user `9986a3dc2450420abf8c260c4c8d109b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:53.428694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9cb78565-8b11-4f13-ae9f-a5fd77deb6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:53.436090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1170/2397] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:02:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:53.816647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.831153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff946fe-63e7-4dfe-9529-e63b8d1e9b86 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.835030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.835639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.835913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.836183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.838083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:53.848238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.849674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.857586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1228/2398] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:54.038863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:54.039148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:54.039425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:54.058614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] MFA Rules not processed for user `53536cc9809f42a493b03687b13c9ab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:54.059798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:54.066995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1171/2399] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:02:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:57.158877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:57.169381 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bdeac-7e66-4699-82ec-d4902409f675 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:57.173862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:57.174756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:57.175300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:57.175645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:57.177929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:57.262509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:57.263965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:57.275384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1229/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:01.873922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:01.875378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:01.890368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea24e5-24f7-4486-a41f-e3319df0f5cc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:01.895393 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:01.896096 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:01.896483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:01.896823 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] PATH_INFO: `/v3/users/7803d5b00079428ba28d956cec4085f8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:01.898024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7803d5b00079428ba28d956cec4085f8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:01.900695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:01.949388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7803d5b00079428ba28d956cec4085f8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:01.950149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7803d5b00079428ba28d956cec4085f8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:01.958010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7803d5b00079428ba28d956cec4085f8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:01.966080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7803d5b00079428ba28d956cec4085f8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:01.978730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-afecb203-70b7-488f-a523-8372167fdee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7803d5b00079428ba28d956cec4085f8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:01.984912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1172/2401] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:01 2022] DELETE /identity/v3/users/7803d5b00079428ba28d956cec4085f8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:02.178378 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.191127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0942029-be30-4fc1-9b5f-066f0ddd600a service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.256539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.257185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.257469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.257752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] PATH_INFO: `/v3/projects/89febcf594be4dc48a97e6199c3da9b9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.258981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=89febcf594be4dc48a97e6199c3da9b9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.261588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.289531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:02.315128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89febcf594be4dc48a97e6199c3da9b9', 'request_id': 'req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:02.321642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89febcf594be4dc48a97e6199c3da9b9', 'request_id': 'req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:02.330490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89febcf594be4dc48a97e6199c3da9b9', 'request_id': 'req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:02.344051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] The token cache is being invalidate because project 89febcf594be4dc48a97e6199c3da9b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:02.344348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:02.345044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4f273e0d-2412-41c1-ae9e-950ba0ef9c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:02.346796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1230/2402] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:02 2022] DELETE /identity/v3/projects/89febcf594be4dc48a97e6199c3da9b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:02.357261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.357546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.357818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.378218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:02.379663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:02.441162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1173/2403] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:02.448991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.449276 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.449550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.469591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:02.471366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:02.480173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1231/2404] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:02.484608 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.495515 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2809659c-bd7a-46f4-9f2d-baa051a687eb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.500253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.500913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.501225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.501499 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.502159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:02.502466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.504079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.516076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1174/2405] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:02.520375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.530539 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e77b00-2c28-4d97-9693-3cc32efd30e2 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.535323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.535932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.536217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.536526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.537158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.539079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.569212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1232/2406] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:02.573633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.583864 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff485f0-48d4-404a-b8b9-e3aaedf6b06d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.614879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:02.645170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.645790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.646071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.646349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.646977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.649187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.673774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1175/2407] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/users => generated 278 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:02.677944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.689625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb6c82-1060-4d84-b113-695a9bbe47f2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.694762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.695371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.695653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.696595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.697248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.698850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.711867 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1233/2408] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:02.713225 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.723464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6fa79-3f4d-46ce-9be6-cf36c8a427e6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.728796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.729376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.729652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.729920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.730559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.732135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6b10a-4f52-4029-846b-0faccb0375f0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.744827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1176/2409] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:02.748787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.758881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0720669d-6610-412c-a21a-e299ccaaeba5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.763569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.764219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.764526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.764801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] PATH_INFO: `/v3/projects/dd5adaa0ac0045c399d3532f57df7853/users/14c82b189757464a87e4720cf096fb45/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.781327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5adaa0ac0045c399d3532f57df7853, user_id=14c82b189757464a87e4720cf096fb45, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.783990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:02.800195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1234/2410] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:02 2022] PUT /identity/v3/projects/dd5adaa0ac0045c399d3532f57df7853/users/14c82b189757464a87e4720cf096fb45/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:02.811005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.811334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.811618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.840223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] MFA Rules not processed for user `14c82b189757464a87e4720cf096fb45`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:02.841375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:02.908337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1177/2411] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:02.912973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:02.976333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb205415-5ced-48f7-825f-850e1cd0728b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:02.981110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:02.981715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:02.981996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:02.982271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:02.982884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:02.984812 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.012647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1235/2412] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:02 2022] POST /identity/v3/projects => generated 355 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:03.017196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.028379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bddef5-fe69-4557-984c-0f892eb1ef04 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.114579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.115198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.115476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.115749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.116375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.118447 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.141552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1178/2413] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:03 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:03.145559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.156954 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0650ad8-88f6-42ab-ae25-7fde7bb24666 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.161852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.162730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.163149 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.163434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.164088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.166291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.178834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1236/2414] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:03.184740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.196438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1323200-d11a-41b7-9a24-b122f802a43a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.201428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.202186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.202547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.203038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] PATH_INFO: `/v3/projects/26b8c098a9a547c584dde7d760eef607/users/320ba6f9e76845e793049af9e3198374/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.234729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b8c098a9a547c584dde7d760eef607, user_id=320ba6f9e76845e793049af9e3198374, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.237545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.261258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1179/2415] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:03 2022] PUT /identity/v3/projects/26b8c098a9a547c584dde7d760eef607/users/320ba6f9e76845e793049af9e3198374/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:03.265334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.275500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6efdb-586e-44cd-8165-ac1dfac6f8e5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.293382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:03.336351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.336996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.337275 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.337574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.338213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.339796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf45cab-8fce-406c-bdeb-cf0fdb401673 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.349920 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1237/2416] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:03.354996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.374095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ed034-a41e-4bcd-a805-96cac9c26c5f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.379938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.380641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.380921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.381190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] PATH_INFO: `/v3/projects/26b8c098a9a547c584dde7d760eef607/users/320ba6f9e76845e793049af9e3198374/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.383126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26b8c098a9a547c584dde7d760eef607, user_id=320ba6f9e76845e793049af9e3198374, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.386360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.388830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:03.398281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1180/2417] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:03 2022] PUT /identity/v3/projects/26b8c098a9a547c584dde7d760eef607/users/320ba6f9e76845e793049af9e3198374/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:03:03.410409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.410717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.411302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.440417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] MFA Rules not processed for user `320ba6f9e76845e793049af9e3198374`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:03.441674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:03.516568 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1238/2418] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:03 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:03.523954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.526316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:03.582351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453fa714-eb9c-4820-a295-be1ab3b939b6 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.586025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.586629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.586905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.587175 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.597030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.598454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.608601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1181/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:03 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:03.684436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:03.694088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87131b1a-db3d-4010-b6a1-af947f7f65e0 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:03.698139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:03.698740 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:03.699023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:03.699299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:03.757091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:03.758534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dae915-3780-4c01-82b3-2a8c62ce54f2 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:03.767592 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1239/2420] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:03 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:13.603880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:13.763570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=82 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:18.858706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:18.921325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f56d31-110c-4af1-8934-f4ff5e926f2f service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:18.925820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:18.926444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:18.926722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:18.926995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] PATH_INFO: `/v3/users/14c82b189757464a87e4720cf096fb45` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:18.928117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=14c82b189757464a87e4720cf096fb45)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:18.930055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:18.975633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14c82b189757464a87e4720cf096fb45'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:18.976294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14c82b189757464a87e4720cf096fb45'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:18.984007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14c82b189757464a87e4720cf096fb45'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:18.990978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14c82b189757464a87e4720cf096fb45'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.010067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14c82b189757464a87e4720cf096fb45'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.015881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1182/2421] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:18 2022] DELETE /identity/v3/users/14c82b189757464a87e4720cf096fb45 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:19.020369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:19.020879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:19.020978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:19.040491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:19.041697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:19.102762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1240/2422] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:19.112418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:19.113811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:19.170005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d70ad3-7f51-4785-9c0e-405c3b082dcb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:19.173705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:19.174251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:19.174527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:19.174798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:19.184443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:19.185867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:19.195189 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1183/2423] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:19.463840 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:19.465345 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:19.478506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6baa30-535d-451f-bbd3-462a94793c82 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:19.483119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:19.483757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:19.484038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:19.484313 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] PATH_INFO: `/v3/projects/dd5adaa0ac0045c399d3532f57df7853` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:19.485466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5adaa0ac0045c399d3532f57df7853)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:19.487374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:19.537632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5adaa0ac0045c399d3532f57df7853', 'request_id': 'req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.547521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5adaa0ac0045c399d3532f57df7853', 'request_id': 'req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.555781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5adaa0ac0045c399d3532f57df7853', 'request_id': 'req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.566862 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] The token cache is being invalidate because project dd5adaa0ac0045c399d3532f57df7853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:19.567151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.567785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.569304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1241/2424] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:19 2022] DELETE /identity/v3/projects/dd5adaa0ac0045c399d3532f57df7853 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:03:19.573271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:19.582727 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f47b1d-1079-4327-aab6-4397181f0392 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:19.601184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:19.641868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:19.642494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:19.642776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:19.643077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] PATH_INFO: `/v3/users/320ba6f9e76845e793049af9e3198374` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:19.644198 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=320ba6f9e76845e793049af9e3198374)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:19.646148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:19.691655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320ba6f9e76845e793049af9e3198374'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.692292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320ba6f9e76845e793049af9e3198374'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.699713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320ba6f9e76845e793049af9e3198374'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.706422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320ba6f9e76845e793049af9e3198374'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.718306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be7645c9-3559-4a1a-b3d2-0f934e97e7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320ba6f9e76845e793049af9e3198374'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:19.724215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1184/2425] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:19 2022] DELETE /identity/v3/users/320ba6f9e76845e793049af9e3198374 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:19.985098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:19.986554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:20.010657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2e192d-4244-4ce5-91f4-f14f6d6739cb admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.067615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.068293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.068541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.068818 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] PATH_INFO: `/v3/projects/26b8c098a9a547c584dde7d760eef607` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.070082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=26b8c098a9a547c584dde7d760eef607)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.072445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.102366 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:20.119975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26b8c098a9a547c584dde7d760eef607', 'request_id': 'req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:20.125362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26b8c098a9a547c584dde7d760eef607', 'request_id': 'req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:20.132997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26b8c098a9a547c584dde7d760eef607', 'request_id': 'req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:20.144450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] The token cache is being invalidate because project 26b8c098a9a547c584dde7d760eef607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:20.144738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:20.145361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c7f72657-2c0a-4d40-b28d-7695c8b7f66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:20.146952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1242/2426] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:19 2022] DELETE /identity/v3/projects/26b8c098a9a547c584dde7d760eef607 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:20.151955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.152442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.152647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.172340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:20.173547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:20.231979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1185/2427] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:20.240497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.240782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.241054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.262164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:20.263367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:20.271238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1243/2428] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:20.275423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.285283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68948093-f633-43f2-83c0-0e9c8391452e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.289909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.290506 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.290787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.291064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.291707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:20.292009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.293640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.304982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1186/2429] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:20.309683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.318702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883a8f14-5c5a-4173-a99c-9523987fd527 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.323976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.324590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.324868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.325136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.325738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.327634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.354404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1244/2430] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:20.358611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.369177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9a6033-1cff-43b3-a1be-26b1c7752047 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.395185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:20.428582 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.429212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.429489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.429760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.431057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.433065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.453414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1187/2431] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:20.457593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.467772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7d482-e8e8-4584-a2a5-4151b8c5ff6e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.472735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.473643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.473643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.473908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.474548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.476147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.486889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1245/2432] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:20.490609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.501520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8494361-7e2b-4397-a17d-b86c682ba167 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.506371 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.506966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.507248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.507521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.508196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.509984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ecd59-3f27-4c52-aae6-0232fa7016fd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.520460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1188/2433] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:20.524608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.534610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9fdad-30b9-42e3-ba50-5dc9713ec4e0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.539250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.540441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.540723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.540992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] PATH_INFO: `/v3/projects/491e59247dbb4e79a38f604e13cb8cb8/users/723d6b1861ea4098a6ae7d3645515b3d/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.555914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491e59247dbb4e79a38f604e13cb8cb8, user_id=723d6b1861ea4098a6ae7d3645515b3d, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.558653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.571047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1246/2434] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:20 2022] PUT /identity/v3/projects/491e59247dbb4e79a38f604e13cb8cb8/users/723d6b1861ea4098a6ae7d3645515b3d/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:20.582453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.582821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.583157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.612211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] MFA Rules not processed for user `723d6b1861ea4098a6ae7d3645515b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:20.613463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:20.676779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1189/2435] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:20.681907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.743384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d870-c556-4a56-9659-fd26fbf75984 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.748598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.749207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.749520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.749797 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.750414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.752317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.778487 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1247/2436] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:20.782631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.793882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e43298-da68-44b5-b78e-7215ecfd0a30 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.848704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.849349 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.849627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.849901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.850546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.853157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.874813 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1190/2437] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:20 2022] POST /identity/v3/users => generated 306 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:03:20.878969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.889195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158024b-b5a9-47d4-9d25-d6d9a8790f86 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.893782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.894411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.894685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.894962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.895596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.897230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.908209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1248/2438] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:20.912366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.923042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2a1df-c5a7-475e-bd90-d8486654af97 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.927646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:20.928293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:20.928598 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:20.928877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] PATH_INFO: `/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36/users/89a82685f649461aa542ee06d0d9ff53/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:20.943326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a2d81abaee4666ae1c3a43952b0f36, user_id=89a82685f649461aa542ee06d0d9ff53, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:20.946162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:20.959110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1191/2439] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:20 2022] PUT /identity/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36/users/89a82685f649461aa542ee06d0d9ff53/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:20.963572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:20.973709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df2c95-ffd5-4a43-8b66-c796dcfb8988 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:20.993651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:21.032224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:21.032872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:21.033159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:21.033437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:21.034079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:21.035691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6870f7-bb05-4783-9f5f-144e4d0b358d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:21.046725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1249/2440] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:21.051029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:21.056574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:21.063101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505503b8-3179-406a-8cd2-f4ef3ebd50a2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:21.068122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:21.068796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:21.069077 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:21.069351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] PATH_INFO: `/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36/users/89a82685f649461aa542ee06d0d9ff53/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:21.071253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0a2d81abaee4666ae1c3a43952b0f36, user_id=89a82685f649461aa542ee06d0d9ff53, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:21.073983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:21.084082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1192/2441] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:21 2022] PUT /identity/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36/users/89a82685f649461aa542ee06d0d9ff53/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:21.094637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:21.095371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:21.095464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:21.124161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] MFA Rules not processed for user `89a82685f649461aa542ee06d0d9ff53`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:21.125418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:21.191688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1250/2442] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:21 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:21.202828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:21.204700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:21.262300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d2089-fb6d-4fc4-b4df-913355c8dbfb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:21.265859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:21.266459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:21.266737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:21.267005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:21.276513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:21.277943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:21.287287 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1193/2443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:21 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:21.364585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:21.374192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864ff24-1489-4e5c-8b90-21ee024788ed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:21.377757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:21.378355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:21.378632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:21.378902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:21.435057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:21.436653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433265e2-d545-4a49-ae5f-71b8761bb744 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:21.445527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1251/2444] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:21 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:25.513191 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:25.574837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2524061c-bf89-438f-8c3c-55d18018dcb4 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:25.579407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:25.580030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:25.580314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:25.580618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] PATH_INFO: `/v3/users/723d6b1861ea4098a6ae7d3645515b3d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:25.581738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=723d6b1861ea4098a6ae7d3645515b3d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:25.583647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:25.631401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723d6b1861ea4098a6ae7d3645515b3d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:25.631985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723d6b1861ea4098a6ae7d3645515b3d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:25.640770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723d6b1861ea4098a6ae7d3645515b3d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:25.647572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723d6b1861ea4098a6ae7d3645515b3d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:25.660607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723d6b1861ea4098a6ae7d3645515b3d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:25.666434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1194/2445] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:25 2022] DELETE /identity/v3/users/723d6b1861ea4098a6ae7d3645515b3d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:25.671234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:25.671691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:25.671802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:25.691144 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:25.692352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:25.733179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:25.752727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1252/2446] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:25.763055 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:25.764605 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:25.778733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:25.823760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1fe777-893b-47dd-be8d-95a34a42cd6e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:25.827512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:25.828116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:25.828416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:25.828704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:25.838260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:25.839693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:25.849446 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1195/2447] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:26.121699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:26.123371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:26.137553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ebab19-8b61-4e4f-a1dc-70cc6999b586 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:26.142437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:26.143085 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:26.143368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:26.143643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] PATH_INFO: `/v3/projects/491e59247dbb4e79a38f604e13cb8cb8` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:26.145292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491e59247dbb4e79a38f604e13cb8cb8)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:26.146751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:26.201454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491e59247dbb4e79a38f604e13cb8cb8', 'request_id': 'req-944832d6-9f4b-4a47-9e11-cf81319f0e79'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.207101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491e59247dbb4e79a38f604e13cb8cb8', 'request_id': 'req-944832d6-9f4b-4a47-9e11-cf81319f0e79'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.214913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491e59247dbb4e79a38f604e13cb8cb8', 'request_id': 'req-944832d6-9f4b-4a47-9e11-cf81319f0e79'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.234282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] The token cache is being invalidate because project 491e59247dbb4e79a38f604e13cb8cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:26.234571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.235268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.236810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1253/2448] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:26 2022] DELETE /identity/v3/projects/491e59247dbb4e79a38f604e13cb8cb8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:03:26.240962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:26.251125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a318bb9-d1ed-4b57-b045-b95b0274f797 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:26.311322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:26.311964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:26.312255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:26.312560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] PATH_INFO: `/v3/users/89a82685f649461aa542ee06d0d9ff53` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:26.318886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89a82685f649461aa542ee06d0d9ff53)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:26.321556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:26.370091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89a82685f649461aa542ee06d0d9ff53'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.370746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89a82685f649461aa542ee06d0d9ff53'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.377833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89a82685f649461aa542ee06d0d9ff53'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.385254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89a82685f649461aa542ee06d0d9ff53'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.396786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-3aa8ef3a-3b15-41e0-a8f4-c62c1d40e506 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89a82685f649461aa542ee06d0d9ff53'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.402624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1196/2449] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:26 2022] DELETE /identity/v3/users/89a82685f649461aa542ee06d0d9ff53 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:26.694047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:26.695500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:26.711784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944832d6-9f4b-4a47-9e11-cf81319f0e79 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:26.778701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:26.779323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:26.779582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:26.779857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] PATH_INFO: `/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:26.781086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0a2d81abaee4666ae1c3a43952b0f36)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:26.783231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:26.836542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0a2d81abaee4666ae1c3a43952b0f36', 'request_id': 'req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.842604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0a2d81abaee4666ae1c3a43952b0f36', 'request_id': 'req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.852176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0a2d81abaee4666ae1c3a43952b0f36', 'request_id': 'req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.859749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:26.866274 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] The token cache is being invalidate because project f0a2d81abaee4666ae1c3a43952b0f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:26.866563 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.867234 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2894fcd4-5c2f-4e5b-9c0f-1bf371b5dd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:26.868772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1254/2450] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:26 2022] DELETE /identity/v3/projects/f0a2d81abaee4666ae1c3a43952b0f36 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:03:26.874090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:26.874662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:26.874662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:26.904540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:26.906178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:26.939443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:26.971707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1197/2451] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:26.980299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:26.980621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:26.980900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.001626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:27.002957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:27.011179 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1255/2452] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:27.015666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.026444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0771713-e162-494f-a3ba-56c933bc0373 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.031234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.031782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.032052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.032319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.033000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:27.033295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.034901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.047579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1198/2453] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:27.051977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.061553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410a842-c6ac-4bf3-b42b-5146e5f523ac None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.066304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.066908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.067185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.067456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.068088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.070044 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.099894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1256/2454] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:27.104852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.117243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b40116-1365-469d-acb0-ac96b4e869bc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.174656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.175273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.175555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.175830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.176502 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.178422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.202834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1199/2455] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:27.207124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.219350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad95ae1-d850-4b64-8cb3-a885ae8dfa09 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.224925 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.225536 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.225816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.226093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.226728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.228318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.239167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1257/2456] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:27.243199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.254063 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95769d1-aee0-4ec0-bcc3-21bd3a8c7980 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.259299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.259902 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.260179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.260489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.261271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.262869 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdd480-5205-47e0-930f-377726bb54ea admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.274592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1200/2457] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:27.278800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.289114 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e7731-8467-4319-aaa2-904b7784dd11 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.293952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.294950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.295458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.295831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] PATH_INFO: `/v3/projects/b682f404fdae4587888e75f99b4c102a/users/7e7c0b45c3264936ad2ba9690b233227/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.312287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b682f404fdae4587888e75f99b4c102a, user_id=7e7c0b45c3264936ad2ba9690b233227, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.315088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.333287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1258/2458] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:27 2022] PUT /identity/v3/projects/b682f404fdae4587888e75f99b4c102a/users/7e7c0b45c3264936ad2ba9690b233227/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:27.345436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.345850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.346216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.374952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] MFA Rules not processed for user `7e7c0b45c3264936ad2ba9690b233227`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:27.376181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:27.447609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1201/2459] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:27.452180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.516522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb578cf-02dc-4248-9ec3-cfc907a0a0ae admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.521881 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.522492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.522770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.523062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.523684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.525633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.555546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1259/2460] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:27.559604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.572292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6e668-7ee9-44d8-a825-75b96fd62c57 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.598840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:27.631068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.631681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.631955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.632234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.632944 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.635439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.657072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1202/2461] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:27.661359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.671736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edf4970-4840-4aa9-9e39-05c5b26d9dc2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.676713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.677326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.677605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.677877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.678517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.680716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.692005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1260/2462] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:27.697042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.707379 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236a7d1-d88b-480a-bce3-7b174eb9af24 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.712720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.713378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.713657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.713929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] PATH_INFO: `/v3/projects/e70280973e1f46fcaa7cc306026a1652/users/34a491520b07468e84eceabdfca3b1ac/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.731805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70280973e1f46fcaa7cc306026a1652, user_id=34a491520b07468e84eceabdfca3b1ac, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.735860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.751363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1203/2463] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:27 2022] PUT /identity/v3/projects/e70280973e1f46fcaa7cc306026a1652/users/34a491520b07468e84eceabdfca3b1ac/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:27.755738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.766272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c16daa3-5d97-47d7-bdd3-5a1e6ba9e7ad admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.826267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.826804 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.827119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.827402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.828049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.829762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b511-c079-4ec5-8774-9e689a77008a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.843700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1261/2464] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:27.848217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:27.860635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dca09f-8790-40de-8b00-ec7504ced082 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:27.866437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:27.867343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.867845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.868114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] PATH_INFO: `/v3/projects/e70280973e1f46fcaa7cc306026a1652/users/34a491520b07468e84eceabdfca3b1ac/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.870545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e70280973e1f46fcaa7cc306026a1652, user_id=34a491520b07468e84eceabdfca3b1ac, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:27.873331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:27.884570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1204/2465] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:27 2022] PUT /identity/v3/projects/e70280973e1f46fcaa7cc306026a1652/users/34a491520b07468e84eceabdfca3b1ac/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:27.894931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:27.895219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:27.895496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:27.904208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:27.925930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] MFA Rules not processed for user `34a491520b07468e84eceabdfca3b1ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:27.927168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:27.999492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1262/2466] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:03:28.011617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:28.013367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:28.073254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b4862-a445-429b-8f91-a82f0fe5b241 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:28.077147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:28.077672 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:28.077945 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:28.078222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:28.088203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:28.089681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:28.103720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1205/2467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:03:28.178364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:28.188110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b3490c-cc04-405c-885a-ff347d327d74 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:28.191946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:28.192595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:28.192877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:28.193155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:28.252138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:28.253614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a80b09-604b-4de6-838a-6310fc1fb3e7 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:28.263391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1263/2468] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:28.546012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:28.608494 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c74a556-ce9b-401b-becb-639b0397d1ac service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:28.616774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:28.618635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:28.621421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:28.621709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] PATH_INFO: `/v3/users/7e7c0b45c3264936ad2ba9690b233227` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:28.622929 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7c0b45c3264936ad2ba9690b233227)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:28.624990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:28.654248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:28.675790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7c0b45c3264936ad2ba9690b233227'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:28.678352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7c0b45c3264936ad2ba9690b233227'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:28.688601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7c0b45c3264936ad2ba9690b233227'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:28.696161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7c0b45c3264936ad2ba9690b233227'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:28.708862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7c0b45c3264936ad2ba9690b233227'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:28.715523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1206/2469] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:28 2022] DELETE /identity/v3/users/7e7c0b45c3264936ad2ba9690b233227 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:28.720261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:28.720595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:28.720853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:28.739379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:28.740638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:28.799232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1264/2470] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:03:28.808922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:28.810296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:28.868308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cecce1-ecf7-4298-b94a-719d07982e50 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:28.871829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:28.872453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:28.872733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:28.873000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:28.881897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:28.883887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:28.893109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1207/2471] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:29.157560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:29.158968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:29.171130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfdd06a-418e-461b-acee-d11e80b08e76 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:29.176796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:29.177438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.177717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.177987 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] PATH_INFO: `/v3/projects/b682f404fdae4587888e75f99b4c102a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.179109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b682f404fdae4587888e75f99b4c102a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:29.181580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:29.206839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:29.230787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b682f404fdae4587888e75f99b4c102a', 'request_id': 'req-6055afeb-1554-4569-b86e-b4c684e24d5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.236105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b682f404fdae4587888e75f99b4c102a', 'request_id': 'req-6055afeb-1554-4569-b86e-b4c684e24d5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.243464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b682f404fdae4587888e75f99b4c102a', 'request_id': 'req-6055afeb-1554-4569-b86e-b4c684e24d5f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.254607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] The token cache is being invalidate because project b682f404fdae4587888e75f99b4c102a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:29.254895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.255525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.257029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1265/2472] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:29 2022] DELETE /identity/v3/projects/b682f404fdae4587888e75f99b4c102a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:29.260998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:29.270644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e4b86-24dc-4e1c-8a64-a0440b1445ac service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:29.327949 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:29.328620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.328898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.329172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] PATH_INFO: `/v3/users/34a491520b07468e84eceabdfca3b1ac` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.330277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a491520b07468e84eceabdfca3b1ac)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:29.332212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:29.377698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a491520b07468e84eceabdfca3b1ac'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.378279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a491520b07468e84eceabdfca3b1ac'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.379934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:29.387363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a491520b07468e84eceabdfca3b1ac'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.395420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a491520b07468e84eceabdfca3b1ac'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.408102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-57a2bb8a-e9a4-4064-a60c-14ddbe2f3c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a491520b07468e84eceabdfca3b1ac'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.413890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1208/2473] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:29 2022] DELETE /identity/v3/users/34a491520b07468e84eceabdfca3b1ac => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:29.689814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:29.691308 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:29.705830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055afeb-1554-4569-b86e-b4c684e24d5f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:29.764811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:29.765444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.765732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.766009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] PATH_INFO: `/v3/projects/e70280973e1f46fcaa7cc306026a1652` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.767129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e70280973e1f46fcaa7cc306026a1652)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:29.769094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:29.814872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e70280973e1f46fcaa7cc306026a1652', 'request_id': 'req-537bb551-e8b7-4166-8071-66cdd571b182'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.821252 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e70280973e1f46fcaa7cc306026a1652', 'request_id': 'req-537bb551-e8b7-4166-8071-66cdd571b182'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.828405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e70280973e1f46fcaa7cc306026a1652', 'request_id': 'req-537bb551-e8b7-4166-8071-66cdd571b182'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.839062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] The token cache is being invalidate because project e70280973e1f46fcaa7cc306026a1652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:29.839347 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.839963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-537bb551-e8b7-4166-8071-66cdd571b182 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:29.841469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1266/2474] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:29 2022] DELETE /identity/v3/projects/e70280973e1f46fcaa7cc306026a1652 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:29.847394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.847678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.848027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.867533 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:29.868772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:29.925131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1209/2475] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:29.933607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.933833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.934137 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.954212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:29.955478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:29.963571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1267/2476] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:03:29.967724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:29.977878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4097a1-b476-434c-94a8-ad8e726708c3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:29.982523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:29.983119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:29.983402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:29.983676 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:29.984322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:29.984655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:29.986246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:29.998318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1210/2477] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:30.002497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.012303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de061159-3ef5-4f5f-a67e-bdc3152a101e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.016958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.017545 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.017830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.018099 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.018718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.020619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.046906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1268/2478] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:30 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:30.051025 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.061490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452ed74-d544-4e81-9b3d-56de6f9d4513 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.118282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.118885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.119167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.119443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.120069 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.122182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.142027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1211/2479] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:30 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:03:30.146348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.156734 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc859e-afed-45c2-a181-2382194151bc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.161395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.161993 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.162302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.162575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.163214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.165395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.175395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1269/2480] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:30.180074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.190152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63031488-aeea-4948-9a7a-eaad0be7c472 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.195117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.195741 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.196020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.196293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.196980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.198558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe06f04-dab2-484e-9ee9-2543fc28ab6a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.209147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1212/2481] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:30.213404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.218588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:30.224978 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce5675-ba37-4cf8-8921-20881eff01a2 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.231000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.231651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.231926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.232197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] PATH_INFO: `/v3/projects/6365fd3fc48d4a999b85825425612dbb/users/8f99c7afd9034b03993284f699a5900d/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.247145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6365fd3fc48d4a999b85825425612dbb, user_id=8f99c7afd9034b03993284f699a5900d, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.249803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.262436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1270/2482] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:30 2022] PUT /identity/v3/projects/6365fd3fc48d4a999b85825425612dbb/users/8f99c7afd9034b03993284f699a5900d/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:30.273474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.273763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.274039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.300990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] MFA Rules not processed for user `8f99c7afd9034b03993284f699a5900d`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:30.302187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:30.321269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:30.370264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1213/2483] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:30.381082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:30.382811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:30.440710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab34f8-679a-4665-86df-f01d9debdd3f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:30.444417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:30.445036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:30.445320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:30.445597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:30.453931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:30.455360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d5580-1802-425b-ade5-632a53b59796 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:30.464634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1271/2484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:40.366667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=18 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:40.460159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=35,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:51.212527 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:51.275429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a0937-ca5f-46d8-8917-366bb5dc4830 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:51.280800 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:51.281423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:51.281703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:51.281979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] PATH_INFO: `/v3/users/8f99c7afd9034b03993284f699a5900d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:51.283087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f99c7afd9034b03993284f699a5900d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:51.285038 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:51.330637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f99c7afd9034b03993284f699a5900d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.331279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f99c7afd9034b03993284f699a5900d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.340100 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f99c7afd9034b03993284f699a5900d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.347326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f99c7afd9034b03993284f699a5900d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.359053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f99c7afd9034b03993284f699a5900d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.364821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1214/2485] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:51 2022] DELETE /identity/v3/users/8f99c7afd9034b03993284f699a5900d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:51.369406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:51.370430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:51.370531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:51.389517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:51.390723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:51.448401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1272/2486] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:51.458068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:51.459518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:51.517978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219b7b4e-49c6-46cd-943a-e6806014b47b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:51.522067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:51.522658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:51.522928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:51.523194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:51.533117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:51.534549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74f4682-9ca0-4740-a6f2-79f01f46c2eb service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:51.544838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1215/2487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:52.090010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.091549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.104021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32daab-6b93-4cb5-bda1-545d9d0cb177 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.108814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.109454 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.109736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.110013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] PATH_INFO: `/v3/projects/6365fd3fc48d4a999b85825425612dbb` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.111141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6365fd3fc48d4a999b85825425612dbb)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.113103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.159830 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6365fd3fc48d4a999b85825425612dbb', 'request_id': 'req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.165288 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6365fd3fc48d4a999b85825425612dbb', 'request_id': 'req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.172996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6365fd3fc48d4a999b85825425612dbb', 'request_id': 'req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.184619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] The token cache is being invalidate because project 6365fd3fc48d4a999b85825425612dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:52.184914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.185551 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ac62d0b6-bb40-45d7-ade5-5f4f88bb3735 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.187048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1273/2488] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:52 2022] DELETE /identity/v3/projects/6365fd3fc48d4a999b85825425612dbb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:52.191969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.192195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.192501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.211942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.213159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.230283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:52.276294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1216/2489] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.284045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.284328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.284627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.303652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.304892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.313238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1274/2490] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.317424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.327833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf41d2-1174-4ef6-9d4a-65510b5761e3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.332352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.332981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.333257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.333531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.334170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:52.334570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.336080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.347705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1217/2491] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:52.351858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.360999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d504d36-5b19-41be-9658-c1d89f00b249 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.365595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.366184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.366459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.366731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.367355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.369241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.397667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1275/2492] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:52.402354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.412960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3efb6-252c-4f9c-80df-0092da1b9a1c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.468088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.468950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.469230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.469500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.470129 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.472140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.493299 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1218/2493] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:52.497348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.507492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c40f8-336a-40da-ad0d-78e8943b2080 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.512567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.513154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.513430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.513701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.514331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.515908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.525532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1276/2494] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:52.529972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.539947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e4a70-afe3-4530-8854-f1774e720059 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.544728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.545319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.545600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.545873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.546513 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.548095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeb122-41a3-4e31-b666-5a44d76ab5dd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.559257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1219/2495] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:52.562554 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.572577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163632f-5765-4e00-8ab7-5789699e941e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.577905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.578589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.578869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.579145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] PATH_INFO: `/v3/projects/dfe50a19254249b2893bc63e4696a80b/users/da26b45ec5fb4e08bc370b1482902ed6/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.596237 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe50a19254249b2893bc63e4696a80b, user_id=da26b45ec5fb4e08bc370b1482902ed6, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.598962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.611923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1277/2496] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:52 2022] PUT /identity/v3/projects/dfe50a19254249b2893bc63e4696a80b/users/da26b45ec5fb4e08bc370b1482902ed6/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:03:52.617210 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9604e7a-32a1-4f64-8c81-23d859821ac2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.617492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9604e7a-32a1-4f64-8c81-23d859821ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.617768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9604e7a-32a1-4f64-8c81-23d859821ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.636700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e9604e7a-32a1-4f64-8c81-23d859821ac2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.637897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e9604e7a-32a1-4f64-8c81-23d859821ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.697227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1220/2497] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.706655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.708362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.730780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:52.765823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9ace0-7704-492d-a0fb-f58e42a692a5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.769529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.770126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.770403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.770673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.779416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.780883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.790005 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1278/2498] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:56.897924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:56.898408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:56.898507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:56.934472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] MFA Rules not processed for user `da26b45ec5fb4e08bc370b1482902ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:56.936163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:56.958532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:57.013227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1221/2499] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:03:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:57.018176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.028522 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975a208-f341-4f35-bf3d-c859568ab557 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.033187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.033792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.034069 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.034340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.035035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.037001 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.066882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1279/2500] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:57 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:57.071356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.091373 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc46dc-4f58-48a7-a7cb-6c6e3967c256 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.158549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.159178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.159457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.159728 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.160370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.162366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.196127 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1222/2501] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:57 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:03:57.197647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.208816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f062db-ca14-4a1e-8aaa-c1af88089093 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.213617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.214235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.214516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.215468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.216037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.217701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.233253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1280/2502] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:57.234549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.246135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff22de5-8ece-4c45-b28e-43280f141efc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.252007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.252724 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.253004 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.253279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] PATH_INFO: `/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae/users/8c3e6283fcb84638b228c8d33e0499bd/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.273547 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf3eb911aec4c15821b3177e21dc2ae, user_id=8c3e6283fcb84638b228c8d33e0499bd, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.276757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.293571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1223/2503] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:57 2022] PUT /identity/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae/users/8c3e6283fcb84638b228c8d33e0499bd/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:57.297371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.309913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fe4-df49-403b-9b12-4f47dbc67d18 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.395231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.395846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.396175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.396484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.397124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.398731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff302539-46ef-4ee6-af9b-c94dda3c53f2 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.409250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1281/2504] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:03:57.416635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:57.427969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd0d4a-9db4-4fbe-8864-7320927e23fe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:57.432951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:57.434179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:57.434453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:57.434861 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] PATH_INFO: `/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae/users/8c3e6283fcb84638b228c8d33e0499bd/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:57.436923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf3eb911aec4c15821b3177e21dc2ae, user_id=8c3e6283fcb84638b228c8d33e0499bd, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:57.439641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:57.451340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1224/2505] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:57 2022] PUT /identity/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae/users/8c3e6283fcb84638b228c8d33e0499bd/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:04:02.056376 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097824-af8f-4698-b36f-cd9b65954a71 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:02.056902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097824-af8f-4698-b36f-cd9b65954a71 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:02.057075 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e097824-af8f-4698-b36f-cd9b65954a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:02.118024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8e097824-af8f-4698-b36f-cd9b65954a71 None None] MFA Rules not processed for user `8c3e6283fcb84638b228c8d33e0499bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:02.119446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8e097824-af8f-4698-b36f-cd9b65954a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:02.212000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1282/2506] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:04:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:02.223356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:02.225620 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:02.299729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66a5a8-04da-424a-afb0-3a61a253d23e admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:02.301659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:02.302668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:02.302668 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:02.303007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:02.333484 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:02.374808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:02.376171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:02.387479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1225/2507] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:02.522584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202835-969e-48f8-9600-bece2fad7156 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:02.522877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202835-969e-48f8-9600-bece2fad7156 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:02.523161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34202835-969e-48f8-9600-bece2fad7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:02.545961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-34202835-969e-48f8-9600-bece2fad7156 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:02.547504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-34202835-969e-48f8-9600-bece2fad7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:02.554065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:02.607255 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1283/2508] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:04:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:02.654084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:02.655556 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:02.727029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f5918-1ed0-4c3d-9657-b46f22177c2c service glance] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:02.732195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:02.732849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:02.733130 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:02.733402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:02.741999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:02.743613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:02.752743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1226/2509] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:04:08.480927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c606-d6d3-4987-bc3a-a76fb8efafcd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:08.481481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c606-d6d3-4987-bc3a-a76fb8efafcd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:08.481481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2458c606-d6d3-4987-bc3a-a76fb8efafcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:08.502981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2458c606-d6d3-4987-bc3a-a76fb8efafcd None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:08.504223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2458c606-d6d3-4987-bc3a-a76fb8efafcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:08.513058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1284/2510] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:04:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:08.529312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:08.543717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6c9c3-96ad-4cdf-a8da-8db7fec90127 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:08.550258 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:08.550984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:08.551344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:08.551683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:08.563422 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:08.565322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6882de15-fdb2-49c1-8142-1a7e3955c532 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:08.577374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1227/2511] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:04:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:04:12.507798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:12.510714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:12.512873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:12.545039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] MFA Rules not processed for user `da26b45ec5fb4e08bc370b1482902ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:12.550399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:12.561463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1285/2512] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:04:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:15.009609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:15.010197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:15.010197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:15.043064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:15.044682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:15.066181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1228/2513] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:04:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:15.088302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:15.112646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3252d30a-e1d4-42da-831b-f86f25106884 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:15.118884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:15.119922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:15.120624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:15.121434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:15.133858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:15.135849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073a2a0-4450-45ff-95c0-28573371a8ec service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:15.145880 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1286/2514] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:04:25.029928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=57 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:25.141788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=32 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:34.360163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:34.438351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fde7fd-c6f4-440a-a15a-0379fd286b5b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:34.442008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:34.442619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:34.442897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:34.443170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:34.444922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:34.525514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:34.527027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f581d1-6f52-4fab-8281-1fa5d50414ca service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:34.535954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1229/2515] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:37.885358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b392-6f43-41c2-b342-a81ca00755ba None None] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:37.886327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b392-6f43-41c2-b342-a81ca00755ba None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:37.886863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9325b392-6f43-41c2-b342-a81ca00755ba None None] PATH_INFO: `/` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:37.888470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1287/2516] 10.222.0.64 () {54 vars in 921 bytes} [Thu Aug 25 03:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:04:37.898020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:37.899012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:37.899542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:37.971229 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] MFA Rules not processed for user `02cff3a52a8e47feb0acc62f084f110a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:37.974223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:38.053145 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=100 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:38.120700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1230/2517] 10.222.0.64 () {58 vars in 1018 bytes} [Thu Aug 25 03:04:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:38.136143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b392-6f43-41c2-b342-a81ca00755ba None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:38.157469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9325b392-6f43-41c2-b342-a81ca00755ba None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:38.163820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:38.164528 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:38.164835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:38.165312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:38.181722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:38.184245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65771e8a-23bd-4e49-bb53-54462ddffc1c service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:38.197102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1288/2518] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:41.980088 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:41.982105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:42.008524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeae00-9cb3-45f6-933b-c4a9ab893d7b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:42.029534 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:42.030431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:42.030934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:42.031935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:42.035594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:42.157577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:42.159031 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:42.178804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1231/2519] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:43.443254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa726-407b-4655-8169-12e938b72473 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:43.443653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa726-407b-4655-8169-12e938b72473 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:43.443825 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32aa726-407b-4655-8169-12e938b72473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:43.495897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f32aa726-407b-4655-8169-12e938b72473 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:43.497387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f32aa726-407b-4655-8169-12e938b72473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:43.507783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1289/2520] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:04:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:43.523213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:43.538521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ba92c-4f81-4789-9e18-63c6070773ed service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:43.547193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:43.547922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:43.548305 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:43.548701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:43.562202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:43.564196 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:43.577636 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1232/2521] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:04:46.253223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aa726-407b-4655-8169-12e938b72473 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:46.255535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f32aa726-407b-4655-8169-12e938b72473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:46.413803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32aa726-407b-4655-8169-12e938b72473 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:46.420757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:46.421810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:46.422199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:46.422580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:46.428384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:46.445943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:46.448689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:46.462162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1290/2522] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:50.625093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:50.626718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:50.649648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82439012-c400-4d2e-9454-a0e6bab55332 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:50.656763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:50.658112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:50.658570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:50.659054 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] PATH_INFO: `/v3/users/fc20609cd99041d0b2509095e8a0c1b6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:50.663184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc20609cd99041d0b2509095e8a0c1b6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:50.667776 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:50.734472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc20609cd99041d0b2509095e8a0c1b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:50.735339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc20609cd99041d0b2509095e8a0c1b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:50.746128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc20609cd99041d0b2509095e8a0c1b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:50.753795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:50.755894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc20609cd99041d0b2509095e8a0c1b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:50.773074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc20609cd99041d0b2509095e8a0c1b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:50.785263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1233/2523] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:04:50 2022] DELETE /identity/v3/users/fc20609cd99041d0b2509095e8a0c1b6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:04:51.002473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:51.013656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8d4b92-e8ad-42d8-966f-bb2ab9ae2c85 service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:51.131909 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:51.133018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:51.133463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:51.133923 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] PATH_INFO: `/v3/projects/4105945a19cc4b81ac64fd94004802ad` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:51.135247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4105945a19cc4b81ac64fd94004802ad)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:51.138096 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:51.218200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4105945a19cc4b81ac64fd94004802ad', 'request_id': 'req-9abb0fb8-999d-4e7a-9209-97d0a420683f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.221216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:51.227113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4105945a19cc4b81ac64fd94004802ad', 'request_id': 'req-9abb0fb8-999d-4e7a-9209-97d0a420683f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.239277 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4105945a19cc4b81ac64fd94004802ad', 'request_id': 'req-9abb0fb8-999d-4e7a-9209-97d0a420683f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.254095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] The token cache is being invalidate because project 4105945a19cc4b81ac64fd94004802ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:04:51.254476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.255226 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.260973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1291/2524] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:04:51 2022] DELETE /identity/v3/projects/4105945a19cc4b81ac64fd94004802ad => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:04:51.261926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:51.264079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:51.285381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0bace-12d5-4580-b1f0-4f03dc510401 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:51.349878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:51.350416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:51.350700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:51.351068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] PATH_INFO: `/v3/users/c18678c9e7c749c6bea0094407f53573` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:51.353256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c18678c9e7c749c6bea0094407f53573)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:51.355245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:51.416545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c18678c9e7c749c6bea0094407f53573'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.417449 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c18678c9e7c749c6bea0094407f53573'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.434663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c18678c9e7c749c6bea0094407f53573'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.447364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c18678c9e7c749c6bea0094407f53573'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.465538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c18678c9e7c749c6bea0094407f53573'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.485719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1234/2525] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:04:51 2022] DELETE /identity/v3/users/c18678c9e7c749c6bea0094407f53573 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:04:51.681426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:51.682951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:51.700817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abb0fb8-999d-4e7a-9209-97d0a420683f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:51.776451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:51.777129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:51.777407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:51.777678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] PATH_INFO: `/v3/projects/13209b5faa5e4d628428dc0c9af9b51e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:51.778810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13209b5faa5e4d628428dc0c9af9b51e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:51.780835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:51.831803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13209b5faa5e4d628428dc0c9af9b51e', 'request_id': 'req-014a15a1-d3ad-48cd-ad36-a249fa25a540'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.838658 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13209b5faa5e4d628428dc0c9af9b51e', 'request_id': 'req-014a15a1-d3ad-48cd-ad36-a249fa25a540'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.846995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13209b5faa5e4d628428dc0c9af9b51e', 'request_id': 'req-014a15a1-d3ad-48cd-ad36-a249fa25a540'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.859120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] The token cache is being invalidate because project 13209b5faa5e4d628428dc0c9af9b51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:04:51.859429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.860082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:04:51.872371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1292/2526] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:04:51 2022] DELETE /identity/v3/projects/13209b5faa5e4d628428dc0c9af9b51e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:04:55.440297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:55.441736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:55.496948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:55.515791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93420672-428f-4de1-b7a2-41ffc547ee1c admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:55.578421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:55.579030 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:55.579310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:55.579579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:55.581331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:55.638646 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:55.640149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b48b3d-f41c-47e3-a094-c88cd798ab27 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:55.648940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1235/2527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:01.855706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:02.586168 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:02.587596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:02.673079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a15a1-d3ad-48cd-ad36-a249fa25a540 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:02.676855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:02.677461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:02.677744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:02.678019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:02.679809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:02.745837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:02.746463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:02.756083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1293/2528] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:05.644858 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=58 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:06.169795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:06.170081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:06.170474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:06.190207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:06.191362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:06.260142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1236/2529] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:06.279229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:06.282388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:06.353594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18968261-cc6b-4a57-a2eb-ddcd5d2e40cf service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:06.362388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:06.363235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:06.363525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:06.363783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:06.380837 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:06.382541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5879a-28b3-4a2b-90af-40d6fd981b70 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:06.410858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1294/2530] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:05:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 03:05:16.034427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:16.036693 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:16.132759 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85f4ef-2332-4711-9839-91e49bde061f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:16.139784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:16.140524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:16.140871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:16.141153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:16.142950 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:16.158111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:16.160617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:16.177586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1237/2531] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:16.401864 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:16.403104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:16.403562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:16.404240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:16.424806 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] MFA Rules not processed for user `9986a3dc2450420abf8c260c4c8d109b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:16.426187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:16.433882 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1295/2532] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:20.906629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:20.908021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:20.919850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3aa16c-5b3e-499a-9d0a-32ea7d1ae760 service placement] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:20.923374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:20.923953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:20.924231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:20.924921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:20.926244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:20.988222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:20.989617 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:20.999852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1238/2533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:24.127185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.128685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.144555 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d755d-9d78-4790-9170-c0b56285150b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:24.150339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:24.150992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.152334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.152334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.153382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.169351 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:24.171902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:24.193879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.196216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.199996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1296/2534] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:24.212002 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74134d-efa6-4db9-84cf-17a0f3f04127 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:24.217799 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:24.218444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.218786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.219111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] PATH_INFO: `/v3/users/53536cc9809f42a493b03687b13c9ab4` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.220309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53536cc9809f42a493b03687b13c9ab4)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:24.225312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:24.250348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:24.281695 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53536cc9809f42a493b03687b13c9ab4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.282438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53536cc9809f42a493b03687b13c9ab4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.292291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53536cc9809f42a493b03687b13c9ab4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.299487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53536cc9809f42a493b03687b13c9ab4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.313203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-61655262-0f9e-4482-b273-256816e384b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53536cc9809f42a493b03687b13c9ab4'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.319363 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1239/2535] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:24 2022] DELETE /identity/v3/users/53536cc9809f42a493b03687b13c9ab4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:24.578533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.592579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddccf4dd-3085-459c-95ed-90c95497822d service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:24.650141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:24.650778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.651058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.651332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] PATH_INFO: `/v3/projects/21f3ce57892746299f029ee5c63c8217` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.652481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f3ce57892746299f029ee5c63c8217)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:24.654395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:24.700941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f3ce57892746299f029ee5c63c8217', 'request_id': 'req-b4e6ae09-5714-4d29-86a9-b134805ba7e6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.706883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f3ce57892746299f029ee5c63c8217', 'request_id': 'req-b4e6ae09-5714-4d29-86a9-b134805ba7e6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.714090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f3ce57892746299f029ee5c63c8217', 'request_id': 'req-b4e6ae09-5714-4d29-86a9-b134805ba7e6'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.725298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] The token cache is being invalidate because project 21f3ce57892746299f029ee5c63c8217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:24.725584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.726231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b4e6ae09-5714-4d29-86a9-b134805ba7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:24.728239 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1297/2536] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:24 2022] DELETE /identity/v3/projects/21f3ce57892746299f029ee5c63c8217 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:24.733369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.733657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.733935 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.780187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:24.781433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.839873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1240/2537] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:24.847981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.848267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.848586 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.870018 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:24.871222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.879766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1298/2538] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:24.884082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.893891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276cb7d6-cac6-4150-9c3f-1bf2a1c4260c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:24.898573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:24.899169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.899458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.899738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.900381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:24.900715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:24.902356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:24.915284 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1241/2539] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:24.919000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.928158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7894726-c5ac-4f49-a42d-d74227a3aa90 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:24.933540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:24.934158 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.934440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.934850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.936028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:24.938008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:24.965028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1299/2540] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:24.969453 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.979610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869a29e-eb33-41a1-b874-9b18f022c497 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.035117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.035717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.035995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.036269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.036947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.038891 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.049625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:25.067049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1242/2541] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:25.068247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.079092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead51eab-0b1f-484e-8ac0-034de355ae5d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.083798 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.084422 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.084705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.084982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.085624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.087718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.098530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1300/2542] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:25.103117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.113177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4e2bb-eb41-4dfe-b163-59d446f15bf9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.118086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.118682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.118960 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.119233 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.119874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.121740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c122cc-200a-4f57-b100-d54c9619c15a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.133521 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1243/2543] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:25.137672 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.147990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311cd75-c031-4087-8fa6-5525270c453c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.153680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.154463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.154752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.155032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] PATH_INFO: `/v3/projects/fd73c4605d05435b9848ebd9e650e0f8/users/dab49e3fbb0846f1826530d7cb18a2b0/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.172956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd73c4605d05435b9848ebd9e650e0f8, user_id=dab49e3fbb0846f1826530d7cb18a2b0, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.175701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.189728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1301/2544] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:25 2022] PUT /identity/v3/projects/fd73c4605d05435b9848ebd9e650e0f8/users/dab49e3fbb0846f1826530d7cb18a2b0/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:25.200786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.201314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.201314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.231603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] MFA Rules not processed for user `dab49e3fbb0846f1826530d7cb18a2b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:25.232913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:25.298439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1244/2545] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:25.303024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.312623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:25.366691 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f5ae2-0f32-4c0a-92a9-e8ecbc4f2b9c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.371824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.372461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.372743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.373015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.373632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.375518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.402172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1302/2546] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:25.406293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.418212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88680e78-deb5-443c-8a98-2ff2cd63cd75 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.474923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.475565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.475841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.476110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.476811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.479235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.501599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1245/2547] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:25.506039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.516961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e8777-7f4f-48d5-95db-b516b284e39c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.521782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.522397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.522673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.522952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.523595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.525294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.536668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1303/2548] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:25.541545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.552591 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd48067b-09f2-48de-b548-70df460bf244 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.558973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.559592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.559873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.560148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.560826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.562414 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c2e7d0-b44e-4fa8-8ec3-d01fa8d9016e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.577112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1246/2549] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:25.580238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.600373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec557fef-263d-4459-93f0-421f9900ebea admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.606323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.607178 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.607628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.608499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] PATH_INFO: `/v3/projects/45c475b45e0a438d82d31db68f0ba017/users/a8b1e91933d54ed88d65a48909b95fd5/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.625580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c475b45e0a438d82d31db68f0ba017, user_id=a8b1e91933d54ed88d65a48909b95fd5, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.628190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.646500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1304/2550] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:25 2022] PUT /identity/v3/projects/45c475b45e0a438d82d31db68f0ba017/users/a8b1e91933d54ed88d65a48909b95fd5/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:25.658715 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.659165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.659520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.691250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] MFA Rules not processed for user `a8b1e91933d54ed88d65a48909b95fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:25.693262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:25.743104 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:25.777012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1247/2551] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:25.781664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.847492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0aa2d-92d1-4bdb-ac15-6e9b463e71b9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.852290 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.853517 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.853800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.854078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.854715 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.856662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.885853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1305/2552] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:25.889867 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.901698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4c56-929a-4a0b-a922-56165cd3fe9f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.957754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.958376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.958635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.958903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.959523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.961463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.982862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1248/2553] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:25 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:25.986790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:25.997451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f56c1e-776d-4ff3-9cd6-161903b60966 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.002087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.002674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.002956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.003228 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.003857 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.005462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.016346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1306/2554] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:26.020667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.031187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892e6b8-916b-42ce-9f69-902b585b14f3 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.035685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.036322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.036629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.036901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] PATH_INFO: `/v3/projects/e6004973edb647c2b1efa113fb2ff60c/users/bfe680720f6b4074b7f52ae99ad60332/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.051397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6004973edb647c2b1efa113fb2ff60c, user_id=bfe680720f6b4074b7f52ae99ad60332, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.054058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.067036 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1249/2555] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:26 2022] PUT /identity/v3/projects/e6004973edb647c2b1efa113fb2ff60c/users/bfe680720f6b4074b7f52ae99ad60332/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:05:26.070946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.081486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8decf52-86c5-4816-83c3-1e5018c17ea9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.110669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:26.143674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.144306 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.144473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.144749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.145389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.146982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617773a-25d7-4ec4-b3e7-a90d33c6a108 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.156480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1307/2556] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:26 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:26.160705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.171525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8a732-6559-44f2-99f0-9d717bf51124 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.176105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.176790 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.177067 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.177341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] PATH_INFO: `/v3/projects/e6004973edb647c2b1efa113fb2ff60c/users/bfe680720f6b4074b7f52ae99ad60332/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.179244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6004973edb647c2b1efa113fb2ff60c, user_id=bfe680720f6b4074b7f52ae99ad60332, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.182480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.192432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1250/2557] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:26 2022] PUT /identity/v3/projects/e6004973edb647c2b1efa113fb2ff60c/users/bfe680720f6b4074b7f52ae99ad60332/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:26.202284 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.202642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.202951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.231336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] MFA Rules not processed for user `bfe680720f6b4074b7f52ae99ad60332`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:26.232593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:26.300612 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1308/2558] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:26.311524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.313252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:26.392432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c0ef5-3dc9-4e0a-b808-6e36e3b86d9b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.396152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.396745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.397033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.397308 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:26.407493 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:26.408973 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:26.418487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1251/2559] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:26.926670 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:26.928102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:26.944365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c32eba2-e656-41c4-b504-e89c5605c026 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:26.947937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:26.948711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:26.948989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:26.949286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:27.006370 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:27.007759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:27.016662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1309/2560] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:26 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:31.088163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:31.096996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a653e44-6054-41a3-8506-a17232d2c2db service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:31.100552 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:31.101141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:31.101413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:31.101681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:31.114830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:31.161294 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:31.162739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99528d09-e624-4176-ba48-2cfc687fe13f service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:31.172140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1252/2561] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:33.258606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:33.310204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:33.322684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2fac5-41cf-48da-ad6e-290524b34b41 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:33.327225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:33.327884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:33.328166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:33.328474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] PATH_INFO: `/v3/users/dab49e3fbb0846f1826530d7cb18a2b0` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:33.329856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab49e3fbb0846f1826530d7cb18a2b0)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:33.331534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:33.377684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab49e3fbb0846f1826530d7cb18a2b0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.385538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab49e3fbb0846f1826530d7cb18a2b0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.392235 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab49e3fbb0846f1826530d7cb18a2b0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.392921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab49e3fbb0846f1826530d7cb18a2b0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.405595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab49e3fbb0846f1826530d7cb18a2b0'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.411338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1310/2562] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:33 2022] DELETE /identity/v3/users/dab49e3fbb0846f1826530d7cb18a2b0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:33.416657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:33.417118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:33.417215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:33.436423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:33.437648 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:33.496769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1253/2563] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:33.506397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:33.507900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:33.573022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae2a13-db75-4d96-90bd-5a0b4adcd48a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:33.576770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:33.577375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:33.577661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:33.577934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:33.587071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:33.589049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:33.598708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1311/2564] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:33.860888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:33.862439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:33.876714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63aef31-5fcc-4d1e-a2b9-d4541be15f32 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:33.883141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:33.883783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:33.884678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:33.884894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] PATH_INFO: `/v3/projects/fd73c4605d05435b9848ebd9e650e0f8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:33.886012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd73c4605d05435b9848ebd9e650e0f8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:33.887948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:33.939736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd73c4605d05435b9848ebd9e650e0f8', 'request_id': 'req-840b519a-4ff2-4cd8-acc3-45afcf4238bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.945419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd73c4605d05435b9848ebd9e650e0f8', 'request_id': 'req-840b519a-4ff2-4cd8-acc3-45afcf4238bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.953432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd73c4605d05435b9848ebd9e650e0f8', 'request_id': 'req-840b519a-4ff2-4cd8-acc3-45afcf4238bc'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.964937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] The token cache is being invalidate because project fd73c4605d05435b9848ebd9e650e0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:33.965478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.966103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:33.967581 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1254/2565] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:33 2022] DELETE /identity/v3/projects/fd73c4605d05435b9848ebd9e650e0f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:33.971625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:33.981188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe96268-b8ca-4623-b2e5-c605585055d3 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:34.035811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:34.036463 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:34.036744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:34.037009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] PATH_INFO: `/v3/users/a8b1e91933d54ed88d65a48909b95fd5` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:34.038184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b1e91933d54ed88d65a48909b95fd5)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:34.040102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:34.055296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:34.094526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b1e91933d54ed88d65a48909b95fd5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.101907 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b1e91933d54ed88d65a48909b95fd5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.109109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b1e91933d54ed88d65a48909b95fd5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.109759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b1e91933d54ed88d65a48909b95fd5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.122217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b1e91933d54ed88d65a48909b95fd5'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.128371 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1312/2566] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:33 2022] DELETE /identity/v3/users/a8b1e91933d54ed88d65a48909b95fd5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:34.396952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:34.398397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:34.416007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b519a-4ff2-4cd8-acc3-45afcf4238bc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:34.456808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:34.478183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:34.478762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:34.479046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:34.479321 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] PATH_INFO: `/v3/projects/45c475b45e0a438d82d31db68f0ba017` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:34.480462 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c475b45e0a438d82d31db68f0ba017)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:34.482393 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:34.526928 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c475b45e0a438d82d31db68f0ba017', 'request_id': 'req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.532579 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c475b45e0a438d82d31db68f0ba017', 'request_id': 'req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.539936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c475b45e0a438d82d31db68f0ba017', 'request_id': 'req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.551424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] The token cache is being invalidate because project 45c475b45e0a438d82d31db68f0ba017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:34.551713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.552353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.553882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1255/2567] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:34 2022] DELETE /identity/v3/projects/45c475b45e0a438d82d31db68f0ba017 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:34.558562 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:34.559970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:34.572717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee26f15-35f8-4960-b0ca-f467a7bac897 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:34.630020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:34.630654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:34.630935 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:34.631210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] PATH_INFO: `/v3/users/bfe680720f6b4074b7f52ae99ad60332` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:34.632585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe680720f6b4074b7f52ae99ad60332)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:34.634518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:34.679513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe680720f6b4074b7f52ae99ad60332'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.687763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe680720f6b4074b7f52ae99ad60332'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.694651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe680720f6b4074b7f52ae99ad60332'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.695318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe680720f6b4074b7f52ae99ad60332'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.707411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4adbad94-775e-42eb-9743-8e0548b50f66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe680720f6b4074b7f52ae99ad60332'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:34.713241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1313/2568] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:34 2022] DELETE /identity/v3/users/bfe680720f6b4074b7f52ae99ad60332 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:34.984140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:34.985651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.000563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac6c00-13f3-4efc-a3f2-68250b2c7b9d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.058480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.059116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.059395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.059670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] PATH_INFO: `/v3/projects/e6004973edb647c2b1efa113fb2ff60c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.060883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6004973edb647c2b1efa113fb2ff60c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.062830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.108984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6004973edb647c2b1efa113fb2ff60c', 'request_id': 'req-036ca710-a0ea-4c6e-af36-3e6dd5788e12'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.114457 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6004973edb647c2b1efa113fb2ff60c', 'request_id': 'req-036ca710-a0ea-4c6e-af36-3e6dd5788e12'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.122798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6004973edb647c2b1efa113fb2ff60c', 'request_id': 'req-036ca710-a0ea-4c6e-af36-3e6dd5788e12'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.131075 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:35.135825 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] The token cache is being invalidate because project e6004973edb647c2b1efa113fb2ff60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:35.136476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.137331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-036ca710-a0ea-4c6e-af36-3e6dd5788e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.139147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1256/2569] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:34 2022] DELETE /identity/v3/projects/e6004973edb647c2b1efa113fb2ff60c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:35.144913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.145209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.145490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.166227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:35.167659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.173294 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:35.229942 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1314/2570] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:35.239706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.239956 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.240232 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.260642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:35.261860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.269805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1257/2571] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:35.273983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.285218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311fbe8a-1396-4728-9293-719c329b3c1e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.289788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.290379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.290656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.290926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.291578 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:35.291896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.293499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.305065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1315/2572] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:35.309327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.318632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b8b388-a3b1-47b0-91d1-36cfdeac22d3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.323898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.324524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.324808 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.325083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.325710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.327610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.355555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1258/2573] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:35.359638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.369652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08d18e-9542-4556-be5c-f07a121b4f53 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.426262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.426930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.427213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.427513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.428135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.430084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.450638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1316/2574] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:35.454827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.466437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd345b-b466-4894-b019-905c5bca9577 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.471424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.472060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.472340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.472702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.473355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.474985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.485327 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1259/2575] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:35.489352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.499888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d98fd0-6983-493f-85a2-438580b0ee39 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.504312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.504941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.505216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.505484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.506112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.507700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bbc599-c476-4e07-a482-6e991ec0263d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.518717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1317/2576] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:35.522698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.532771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d070b91-052c-4e5f-98dc-a59e56becda5 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.537703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.539540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.539540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.539540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] PATH_INFO: `/v3/projects/94d1b810f3a6497086cd4dafa00d45f2/users/7f759acc19ea466fa40c9004bbf127f1/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.554389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d1b810f3a6497086cd4dafa00d45f2, user_id=7f759acc19ea466fa40c9004bbf127f1, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.557660 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.572301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1260/2577] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:35 2022] PUT /identity/v3/projects/94d1b810f3a6497086cd4dafa00d45f2/users/7f759acc19ea466fa40c9004bbf127f1/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:35.583899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.584471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.584589 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.612172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] MFA Rules not processed for user `7f759acc19ea466fa40c9004bbf127f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:35.613448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.679499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1318/2578] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:35.691342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.693103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:35.749705 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b097b6-be65-493f-be61-827722e0ce5f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.753485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.754033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.754313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.754589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.763442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.764917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac72d1a-f29a-4bdc-8809-b0aa206b7f69 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.773771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1261/2579] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:35 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:35.792891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:35.801450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:35.856166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ea34b-c574-429a-90a0-374064f88973 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:35.860835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:35.861460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.861744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.862016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] PATH_INFO: `/v3/users/7f759acc19ea466fa40c9004bbf127f1` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.863147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f759acc19ea466fa40c9004bbf127f1)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:35.865113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:35.911261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f759acc19ea466fa40c9004bbf127f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.919486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f759acc19ea466fa40c9004bbf127f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.926757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f759acc19ea466fa40c9004bbf127f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.927457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f759acc19ea466fa40c9004bbf127f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.940278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f759acc19ea466fa40c9004bbf127f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:35.946448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1319/2580] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:35 2022] DELETE /identity/v3/users/7f759acc19ea466fa40c9004bbf127f1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:35.950981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:35.951268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:35.951541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:35.970234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:35.971430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.028351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1262/2581] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:36.038458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.039849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.096128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2645867-be62-4fb9-8f2a-6eb9b47202e5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.099742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.100333 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.100638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.100906 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.110201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.111615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc9a0f-3b6a-45a8-b6ca-124ad2bfa90a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.121638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1320/2582] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:36.398200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.400200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.417184 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00e840-e516-443a-938e-c6d0d0a2eb1a None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.421899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.422530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.423278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.423278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] PATH_INFO: `/v3/projects/94d1b810f3a6497086cd4dafa00d45f2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.424167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d1b810f3a6497086cd4dafa00d45f2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.426095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.464607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:36.476290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d1b810f3a6497086cd4dafa00d45f2', 'request_id': 'req-1d914967-473f-408f-906e-4b5a1dc53c67'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:36.482501 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d1b810f3a6497086cd4dafa00d45f2', 'request_id': 'req-1d914967-473f-408f-906e-4b5a1dc53c67'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:36.489852 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d1b810f3a6497086cd4dafa00d45f2', 'request_id': 'req-1d914967-473f-408f-906e-4b5a1dc53c67'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:36.501052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] The token cache is being invalidate because project 94d1b810f3a6497086cd4dafa00d45f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:36.501338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:36.501985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1d914967-473f-408f-906e-4b5a1dc53c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:36.503464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1263/2583] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:36 2022] DELETE /identity/v3/projects/94d1b810f3a6497086cd4dafa00d45f2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:36.508245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.508569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.508872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.528668 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:36.529838 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.554236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:36.590632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1321/2584] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:36.598355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.598641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.598920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.618991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:36.620773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.628868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1264/2585] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:36.633126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.643317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb3363-98ee-4bd0-ab5e-0f61dc4603f7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.647886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.648518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.648803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.649079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.650350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:36.650653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.652258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.664374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1322/2586] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:36.668612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.678147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358bcc1-f40e-46e6-bc92-c9a296811017 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.682757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.683351 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.683625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.683893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.684559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.686426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.713914 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1265/2587] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:36 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:36.718348 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.728433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9990-f240-4647-a1e9-3d7ba95f3bd0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.784966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.785677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.785965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.786241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.786904 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.788977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.810485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1323/2588] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:36 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:36.814597 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.825367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e7ea1-4e0a-4244-9310-39f56b1f54de admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.830788 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.831389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.831661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.831931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.832599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.834182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.844893 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1266/2589] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:36.848829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.858947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527dddf-06d6-4c8e-8595-6f72455cac3e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.863531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.864120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.864420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.864697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.865330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.866927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfae7f-d43b-4cd3-a9cc-3ca9b00c56f1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.877924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1324/2590] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:05:36.882029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.892503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ccf1f-f3e2-4bfd-bf46-e7d974648fc1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.897421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.898078 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.898357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.898634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] PATH_INFO: `/v3/projects/e1fee2dc81bc4fc1a70f615a11d0be93/users/868f60590a2b4a209cc06d33e41ba233/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.914343 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1fee2dc81bc4fc1a70f615a11d0be93, user_id=868f60590a2b4a209cc06d33e41ba233, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.917079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.930874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1267/2591] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:36 2022] PUT /identity/v3/projects/e1fee2dc81bc4fc1a70f615a11d0be93/users/868f60590a2b4a209cc06d33e41ba233/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:36.941845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.942127 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.942432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.970845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] MFA Rules not processed for user `868f60590a2b4a209cc06d33e41ba233`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:36.972077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.037354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1325/2592] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:37.048526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:37.050202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.107541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f63-7b6f-4785-b929-162c6dd8d903 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:37.111137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:37.111743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.112024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.112301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.121249 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:37.122690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e9dc2-b8e4-44bb-ae1e-fd3be3ed0e44 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:37.131557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1268/2593] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:37.153300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:37.179485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:37.215750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106b0c3c-9dca-48e4-ba11-1e9b908c0b39 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:37.220317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:37.220964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.221241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.221511 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] PATH_INFO: `/v3/users/868f60590a2b4a209cc06d33e41ba233` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.222621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=868f60590a2b4a209cc06d33e41ba233)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:37.224599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:37.269472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '868f60590a2b4a209cc06d33e41ba233'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.276696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '868f60590a2b4a209cc06d33e41ba233'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.283647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '868f60590a2b4a209cc06d33e41ba233'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.284295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '868f60590a2b4a209cc06d33e41ba233'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.295676 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '868f60590a2b4a209cc06d33e41ba233'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.301444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1326/2594] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:37 2022] DELETE /identity/v3/users/868f60590a2b4a209cc06d33e41ba233 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:37.306354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.306644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.306921 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.326095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:37.327207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.384483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1269/2595] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:37.394146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:37.395559 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.453510 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46db630-4c94-4ac6-8c64-e2e09df74a7c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:37.457136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:37.457736 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.458012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.458278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.467247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:37.468683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a916a5b-d487-4711-927d-05aafcf73587 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:37.478391 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1327/2596] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:37.750996 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:37.752483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.759706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:37.766090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990481b-162f-433c-9f83-3c34e174a34c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:37.772022 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:37.772770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.773146 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.773420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] PATH_INFO: `/v3/projects/e1fee2dc81bc4fc1a70f615a11d0be93` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.775062 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1fee2dc81bc4fc1a70f615a11d0be93)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:37.777081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:37.822386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1fee2dc81bc4fc1a70f615a11d0be93', 'request_id': 'req-8f033a64-314b-4cb1-846b-1b00cc51b080'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.827951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1fee2dc81bc4fc1a70f615a11d0be93', 'request_id': 'req-8f033a64-314b-4cb1-846b-1b00cc51b080'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.834650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1fee2dc81bc4fc1a70f615a11d0be93', 'request_id': 'req-8f033a64-314b-4cb1-846b-1b00cc51b080'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.846199 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] The token cache is being invalidate because project e1fee2dc81bc4fc1a70f615a11d0be93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:37.846488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.847123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-8f033a64-314b-4cb1-846b-1b00cc51b080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:37.848625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1270/2597] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:37 2022] DELETE /identity/v3/projects/e1fee2dc81bc4fc1a70f615a11d0be93 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:37.853971 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.854479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.854575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.874998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:37.876207 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.919300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:37.937738 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1328/2598] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:37.946058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.946404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.946683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.966694 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:37.967890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:37.975746 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1271/2599] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:37.980556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:37.990233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49355a3d-1eb6-4991-9432-2c815a97cb2b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:37.994719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:37.995307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:37.995587 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:37.995852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:37.996552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:37.996850 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:37.998420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.009652 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1329/2600] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:38.013952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.023148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f08a-978a-4e91-b6f5-237f26c1ce06 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.028665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.029262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.029541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.029816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.030434 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.032304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.059459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1272/2601] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:38.064642 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.081050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9ab0-cce1-454e-b43d-df1b6951db39 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.138112 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.138717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.138996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.139268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.139883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.141810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.163029 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1330/2602] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:38.167253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.177699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ead46-2712-454f-9b5f-a1ea97f22e97 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.182779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.183627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.183909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.184187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.184873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.186512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.196980 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1273/2603] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:38.201086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.210894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f21c3-fc66-4373-8126-50a7ad2b4477 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.216342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.216963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.217242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.217518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.218153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.219732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ba5c1-6221-4a32-af68-d0df7846412c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.230166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1331/2604] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:38.234382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.244292 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17d153-c73f-4bcf-9872-a55b8de46a47 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.248806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.249463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.249721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.249995 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] PATH_INFO: `/v3/projects/5782ef481d3348cda3ef957b55d22696/users/1731a83e645c4e828466962e463bc65a/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.264756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5782ef481d3348cda3ef957b55d22696, user_id=1731a83e645c4e828466962e463bc65a, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.267375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.280318 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1274/2605] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:38 2022] PUT /identity/v3/projects/5782ef481d3348cda3ef957b55d22696/users/1731a83e645c4e828466962e463bc65a/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:38.290711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.290995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.291291 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.319619 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] MFA Rules not processed for user `1731a83e645c4e828466962e463bc65a`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:38.320921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:38.385858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1332/2606] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:38.389531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.450721 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f5f18-5447-4516-bba9-fbbd2d4d3c27 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.455238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.455842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.456115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.456381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.457023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.458894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.485624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1275/2607] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:38.489636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.500976 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eee95e-8ac5-403b-8b1a-f0b4e1e0b5dd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.540283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:38.558350 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.558966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.559249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.559550 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.560209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.562186 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.583264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1333/2608] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:38.587629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.598395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e11c-9b4d-42c0-8cd7-f4b59105adf7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.602994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.603604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.603884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.604160 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.604840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.606437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.607699 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:38.619665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1276/2609] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:38.623745 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.633774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661d076-3f15-4353-b130-689d7c54b636 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.639269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.639866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.640143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.640440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.641078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.642692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09f318-4adb-457b-931e-98247449a304 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.652553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1334/2610] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:38.656793 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.666991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4fa04-6627-4161-b99f-5197dfb2b475 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.671896 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.672567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.672847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.673121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] PATH_INFO: `/v3/projects/6578f005238942de8b705ea927e6be0d/users/c9fefb10b74646938776d94157d89c3f/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.688990 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6578f005238942de8b705ea927e6be0d, user_id=c9fefb10b74646938776d94157d89c3f, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.691803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.705178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1277/2611] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:38 2022] PUT /identity/v3/projects/6578f005238942de8b705ea927e6be0d/users/c9fefb10b74646938776d94157d89c3f/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:05:38.716605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.716763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.716992 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.746600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] MFA Rules not processed for user `c9fefb10b74646938776d94157d89c3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:38.747961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:38.811446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1335/2612] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:38.815878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.877044 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de1ac5a-fe98-4210-b621-d925ce1f22fb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.882450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.883057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.883339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.883615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.884282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.886492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.912764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1278/2613] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:38.917437 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.928010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194b37d-d0af-4f38-9d02-1efdf5ff03be None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.983194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.983728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.984014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.984293 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.984949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.986871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.008248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1336/2614] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:39.012187 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.022590 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527834a-6855-4e14-bd6c-3eaff5ed1252 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.027208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.027815 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.028092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.028364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.029033 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.030623 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.041716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1279/2615] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:39.045892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.056541 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ead70-f359-4dc1-924f-68c8af1ea604 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.061204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.061859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.062142 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.062417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] PATH_INFO: `/v3/projects/603cabe9c2c64a0f858a6f6eff09153b/users/295d14eaed8d42f3bc6b96c9ed747fb2/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.077028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603cabe9c2c64a0f858a6f6eff09153b, user_id=295d14eaed8d42f3bc6b96c9ed747fb2, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.079663 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.093129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1337/2616] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:39 2022] PUT /identity/v3/projects/603cabe9c2c64a0f858a6f6eff09153b/users/295d14eaed8d42f3bc6b96c9ed747fb2/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:39.097034 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.107772 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2f050-591f-4b63-bfac-f9ed47579f8d admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.162159 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.162832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.163118 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.163388 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.164057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.166194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f019c-f530-49c4-9456-146997356c94 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.176303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1280/2617] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:39.180450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.191446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc5dd76-8eca-42b5-b071-fad305d93f17 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.196163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.196847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.197126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.197403 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] PATH_INFO: `/v3/projects/603cabe9c2c64a0f858a6f6eff09153b/users/295d14eaed8d42f3bc6b96c9ed747fb2/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.199325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=603cabe9c2c64a0f858a6f6eff09153b, user_id=295d14eaed8d42f3bc6b96c9ed747fb2, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.202093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.212163 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1338/2618] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:39 2022] PUT /identity/v3/projects/603cabe9c2c64a0f858a6f6eff09153b/users/295d14eaed8d42f3bc6b96c9ed747fb2/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:39.222475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.222765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.223041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.251540 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] MFA Rules not processed for user `295d14eaed8d42f3bc6b96c9ed747fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:39.252835 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:39.282270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:39.321539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1281/2619] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:39.333477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:39.335185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:39.341457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:39.396013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb200-9e3a-4a97-b36e-26149c5285f4 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:39.401377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:39.401989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:39.402271 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:39.402569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:39.461264 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:39.463367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:39.472990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1339/2620] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:40.976603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:40.978607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:40.990438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7558f8d-6702-46e2-8743-5a4c866ba2c2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:40.994020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:40.994613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:40.994924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:40.995200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:41.050293 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:41.051779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:41.060848 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1282/2621] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:41.594246 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:41.603530 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048041d0-df20-4202-9d24-5ce6fb575180 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:41.607266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:41.607905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:41.608188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:41.608485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:41.619265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:41.621067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35274026-d3b1-4837-ac0e-a2a806d22e31 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:41.635657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1340/2622] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:45.484964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:45.546444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8931cee-9082-4a1b-8f50-555dbb7e51e2 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:45.550984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:45.551607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.551884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.552156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] PATH_INFO: `/v3/users/1731a83e645c4e828466962e463bc65a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.553303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1731a83e645c4e828466962e463bc65a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:45.555202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:45.600955 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1731a83e645c4e828466962e463bc65a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:45.601599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1731a83e645c4e828466962e463bc65a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:45.609227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1731a83e645c4e828466962e463bc65a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:45.616208 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1731a83e645c4e828466962e463bc65a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:45.620729 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:45.630306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1731a83e645c4e828466962e463bc65a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:45.636905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1283/2623] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:45 2022] DELETE /identity/v3/users/1731a83e645c4e828466962e463bc65a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:45.641611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.642101 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.642222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.661155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:45.662352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:45.720082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1341/2624] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:05:45.729698 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:45.731066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:45.787571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d869d9-5613-4cb7-b480-e42be3de9077 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:45.791245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:45.791875 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:45.792152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:45.792452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:45.801634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:45.803085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:45.812937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1284/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:46.088081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:46.090014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:46.102067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b100bd-7f04-4af0-8626-1b341dcbaab4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:46.106794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:46.107424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:46.107822 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:46.108036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] PATH_INFO: `/v3/projects/5782ef481d3348cda3ef957b55d22696` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:46.109090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5782ef481d3348cda3ef957b55d22696)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:46.111012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:46.158602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:46.166823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5782ef481d3348cda3ef957b55d22696', 'request_id': 'req-e5a41618-11bc-419f-b655-3c31c561b861'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.172326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5782ef481d3348cda3ef957b55d22696', 'request_id': 'req-e5a41618-11bc-419f-b655-3c31c561b861'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.179702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5782ef481d3348cda3ef957b55d22696', 'request_id': 'req-e5a41618-11bc-419f-b655-3c31c561b861'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.191330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] The token cache is being invalidate because project 5782ef481d3348cda3ef957b55d22696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:46.191621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.192248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.193766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1342/2626] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:46 2022] DELETE /identity/v3/projects/5782ef481d3348cda3ef957b55d22696 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:46.197866 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:46.208538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b9718-52be-46f9-864d-45ed846aaa90 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:46.264408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:46.264968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:46.265244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:46.265512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] PATH_INFO: `/v3/users/c9fefb10b74646938776d94157d89c3f` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:46.266615 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fefb10b74646938776d94157d89c3f)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:46.268568 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:46.316785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fefb10b74646938776d94157d89c3f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.317424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fefb10b74646938776d94157d89c3f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.324634 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fefb10b74646938776d94157d89c3f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.331432 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fefb10b74646938776d94157d89c3f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.344013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fefb10b74646938776d94157d89c3f'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.349756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1285/2627] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:46 2022] DELETE /identity/v3/users/c9fefb10b74646938776d94157d89c3f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:46.614431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:46.615871 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:46.630725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a41618-11bc-419f-b655-3c31c561b861 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:46.690792 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:46.691468 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:46.691717 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:46.692094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] PATH_INFO: `/v3/projects/6578f005238942de8b705ea927e6be0d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:46.693262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6578f005238942de8b705ea927e6be0d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:46.695265 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:46.741236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6578f005238942de8b705ea927e6be0d', 'request_id': 'req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.746781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6578f005238942de8b705ea927e6be0d', 'request_id': 'req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.753915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6578f005238942de8b705ea927e6be0d', 'request_id': 'req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.764953 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] The token cache is being invalidate because project 6578f005238942de8b705ea927e6be0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:46.765241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.765887 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.767363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1343/2628] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:46 2022] DELETE /identity/v3/projects/6578f005238942de8b705ea927e6be0d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:46.771315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:46.772756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:46.785941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be895170-60f0-44e2-ac6e-9102351d581f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:46.789444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:46.843402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:46.843952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:46.844234 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:46.844577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] PATH_INFO: `/v3/users/295d14eaed8d42f3bc6b96c9ed747fb2` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:46.845701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295d14eaed8d42f3bc6b96c9ed747fb2)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:46.847624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:46.892786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295d14eaed8d42f3bc6b96c9ed747fb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.893439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295d14eaed8d42f3bc6b96c9ed747fb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.901740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295d14eaed8d42f3bc6b96c9ed747fb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.909147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295d14eaed8d42f3bc6b96c9ed747fb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.921802 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-6de6c38e-e13a-44c6-bd41-407722cff867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295d14eaed8d42f3bc6b96c9ed747fb2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:46.927749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1286/2629] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:46 2022] DELETE /identity/v3/users/295d14eaed8d42f3bc6b96c9ed747fb2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:47.201705 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.203131 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:47.218329 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4235e-69a7-4ad2-8f9d-c5841afdaf4b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.268769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:47.275109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.275957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.277021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.277719 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] PATH_INFO: `/v3/projects/603cabe9c2c64a0f858a6f6eff09153b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.278832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] RBAC: Authorizing `identity:delete_project(project_id=603cabe9c2c64a0f858a6f6eff09153b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.281289 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.327577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '603cabe9c2c64a0f858a6f6eff09153b', 'request_id': 'req-77452779-f84c-43dc-a62e-9322517ea67c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:47.332968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '603cabe9c2c64a0f858a6f6eff09153b', 'request_id': 'req-77452779-f84c-43dc-a62e-9322517ea67c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:47.341009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '603cabe9c2c64a0f858a6f6eff09153b', 'request_id': 'req-77452779-f84c-43dc-a62e-9322517ea67c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:47.353135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] The token cache is being invalidate because project 603cabe9c2c64a0f858a6f6eff09153b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:47.353423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:47.354053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77452779-f84c-43dc-a62e-9322517ea67c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:47.355521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1344/2630] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:47 2022] DELETE /identity/v3/projects/603cabe9c2c64a0f858a6f6eff09153b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:47.361337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.361619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.361888 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.387966 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:47.389190 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:47.446883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1287/2631] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:47.456193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.456518 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.456799 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.476524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:47.477749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:47.485716 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1345/2632] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:47.489845 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.500163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf95bf0-1914-4517-b4a2-c42d783c8f00 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.504794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.505389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.505669 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.505941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.506580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:47.506878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.508548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.520571 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1288/2633] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:47.524710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.533780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a48cff-2d65-4676-8a9f-46c148cde38e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.538311 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.538884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.539160 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.539430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.540038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.541980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.569267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1346/2634] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:47 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:47.573951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.583920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4d491-92db-49e4-820d-8e0316e20dbd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.593083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:47.642047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.642583 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.642868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.643144 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.643797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.645744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.669372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1289/2635] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:47 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:05:47.670560 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.680664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a314329-4db9-47c3-944d-d6b64a5af7d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.686169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.686758 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.687032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.687303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.687931 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.689549 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.699917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1347/2636] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:47.703968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.713909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb920051-c1e9-4ba7-bc1d-cffef4925e9f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.719238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.719839 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.720117 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.720406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.721060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.722782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790f58c4-6949-4753-b0b1-d1235f7d0b30 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.734581 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1290/2637] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:47.738848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.749433 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f32600-5d97-4068-b97f-0f91535d7fd6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.754356 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.755062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.755343 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.755616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] PATH_INFO: `/v3/projects/57d3ed2bd978406b9f423cc2b328053d/users/17ab6eff46654252a3fec65cb89ac421/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.771748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57d3ed2bd978406b9f423cc2b328053d, user_id=17ab6eff46654252a3fec65cb89ac421, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.774439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.788111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1348/2638] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:47 2022] PUT /identity/v3/projects/57d3ed2bd978406b9f423cc2b328053d/users/17ab6eff46654252a3fec65cb89ac421/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:47.798911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.799375 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.799467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.826806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] MFA Rules not processed for user `17ab6eff46654252a3fec65cb89ac421`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:47.828047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:47.893514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1291/2639] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:47.905128 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:47.906849 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:47.963222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11072f21-edde-4b7b-98fc-a492b1df2140 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:47.967180 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:47.967782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:47.968060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:47.968334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:47.976504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:47.978203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36997de5-fbcf-41a3-9957-8680cb0f6a5e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:47.987245 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1349/2640] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:47 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:50.529374 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:50.591098 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044546f1-5700-42a4-a3b7-a8090beb62fa None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:50.595542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:50.596161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:50.596474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:50.596749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] PATH_INFO: `/v3/users/17ab6eff46654252a3fec65cb89ac421` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:50.597853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ab6eff46654252a3fec65cb89ac421)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:50.599763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:50.622525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:50.647545 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ab6eff46654252a3fec65cb89ac421'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:50.648111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ab6eff46654252a3fec65cb89ac421'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:50.655278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ab6eff46654252a3fec65cb89ac421'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:50.662182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ab6eff46654252a3fec65cb89ac421'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:50.673783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ab6eff46654252a3fec65cb89ac421'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:50.679524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1292/2641] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:50 2022] DELETE /identity/v3/users/17ab6eff46654252a3fec65cb89ac421 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:50.686491 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:50.686983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:50.687093 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:50.706520 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:50.707724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:50.727210 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:50.767902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1350/2642] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:50.777829 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:50.779231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:50.836338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff93c35-c17c-47e4-b30d-915d66fa6340 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:50.840275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:50.840909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:50.841192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:50.841467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:50.850483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:50.851918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9514f753-3e1c-48ef-8cde-fcf9518bd371 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:50.861909 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1293/2643] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:51.121897 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.123386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.138662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336889e-648c-4bac-8a3e-d40d7bbeb488 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.144832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.145599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.145890 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.146165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] PATH_INFO: `/v3/projects/57d3ed2bd978406b9f423cc2b328053d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.147436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] RBAC: Authorizing `identity:delete_project(project_id=57d3ed2bd978406b9f423cc2b328053d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.149582 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.197392 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57d3ed2bd978406b9f423cc2b328053d', 'request_id': 'req-4a8728a2-e63c-4afa-a78d-12ee3166bfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:51.202750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57d3ed2bd978406b9f423cc2b328053d', 'request_id': 'req-4a8728a2-e63c-4afa-a78d-12ee3166bfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:51.211140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57d3ed2bd978406b9f423cc2b328053d', 'request_id': 'req-4a8728a2-e63c-4afa-a78d-12ee3166bfff'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:51.223832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] The token cache is being invalidate because project 57d3ed2bd978406b9f423cc2b328053d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:51.224120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:51.224776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-4a8728a2-e63c-4afa-a78d-12ee3166bfff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:51.226260 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1351/2644] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:51 2022] DELETE /identity/v3/projects/57d3ed2bd978406b9f423cc2b328053d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:51.231817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.232106 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.232381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.253193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:51.254416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.312223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1294/2645] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:51.320041 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.320325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.320634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.340667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:51.341879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.349820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1352/2646] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:51.354006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.364197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c2846-e8ae-4d32-8d23-88ef16eb4063 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.368765 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.369357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.369632 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.369900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.370536 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:05:51.370832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.372444 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.384153 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1295/2647] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:05:51.388259 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.397577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f0dd1-d97b-4b5e-95ee-a65ba2a20b99 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.403193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.403801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.404082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.404352 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.405053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.406984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.435042 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1353/2648] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:05:51 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:51.439202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.449397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60f277-fd56-4497-a1cf-df8d5c264644 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.477880 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:51.508753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.509488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.509773 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.510065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.510710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.512654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.534027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1296/2649] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:05:51 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:05:51.538117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.549258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df52d9d-8d65-42f0-a56b-488934c1937e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.553794 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.554386 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.554661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.554932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.555571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.557189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.566948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1354/2650] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:51.570817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.581222 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28338bef-9f1f-4533-aa5f-ed766d01e842 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.585846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.586438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.586716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.586991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.587624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.590112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52233147-9f95-450a-9f93-405cfea6de41 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.600329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1297/2651] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:05:51.604384 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.614407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fceb0-9c6e-4b20-8649-ac4a2a10cdaa admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.619053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.619704 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.619989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.620268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] PATH_INFO: `/v3/projects/cced5962e75d4df7a1014ff7f7845ba1/users/ebc58cc61d1e4b87a1882a4e9a8cc03a/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.634508 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cced5962e75d4df7a1014ff7f7845ba1, user_id=ebc58cc61d1e4b87a1882a4e9a8cc03a, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.637701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.652546 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1355/2652] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:05:51 2022] PUT /identity/v3/projects/cced5962e75d4df7a1014ff7f7845ba1/users/ebc58cc61d1e4b87a1882a4e9a8cc03a/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:51.657691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ef68-e7d1-45e4-82f1-4f618284a4c3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.657979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ef68-e7d1-45e4-82f1-4f618284a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.658259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca80ef68-e7d1-45e4-82f1-4f618284a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.676455 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ca80ef68-e7d1-45e4-82f1-4f618284a4c3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:51.677652 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ca80ef68-e7d1-45e4-82f1-4f618284a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.736846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1298/2653] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:51.746465 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.748175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.802017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:51.808411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e581f80-9856-4298-ac1b-4ab8641503f8 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.813089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.813700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.813995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.814268 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.823724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.825174 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.834439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1356/2654] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:52.456876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1720-ab24-46f5-a2e9-43d25d9bd526 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:52.457170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1720-ab24-46f5-a2e9-43d25d9bd526 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:52.457445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98e1720-ab24-46f5-a2e9-43d25d9bd526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:52.486200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b98e1720-ab24-46f5-a2e9-43d25d9bd526 None None] MFA Rules not processed for user `ebc58cc61d1e4b87a1882a4e9a8cc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:52.487428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b98e1720-ab24-46f5-a2e9-43d25d9bd526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:52.554716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1299/2655] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:52.567132 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:52.568659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:52.627802 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7198-dc8d-499c-ab3d-c11229a22036 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:52.631502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:52.632116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:52.632416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:52.632706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:52.641285 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:52.642759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:52.651570 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1357/2656] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:54.000900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:54.001472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:54.001472 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:54.019862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] MFA Rules not processed for user `ebc58cc61d1e4b87a1882a4e9a8cc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:54.021102 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:54.027971 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1300/2657] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:05:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:02.647709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=31 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:04.014618 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=82,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:20.686046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.695617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e0088-d190-40d9-ab4c-94f718463d6a service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.699217 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.699816 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.700666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.700944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.702655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:20.714572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.716626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.726000 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1358/2658] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:23.686871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:23.688516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:23.704460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4b7fb-2674-4d2a-9aac-b4cf61bf4cf9 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:23.709134 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:23.709752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:23.710039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:23.710317 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] PATH_INFO: `/v3/users/7bb057384cf94a249c95fce8f7eff4e0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:23.711461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb057384cf94a249c95fce8f7eff4e0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:23.713708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:23.764560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb057384cf94a249c95fce8f7eff4e0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.765312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb057384cf94a249c95fce8f7eff4e0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.773740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb057384cf94a249c95fce8f7eff4e0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.781520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb057384cf94a249c95fce8f7eff4e0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.793703 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c464b07c-f47b-47ae-a870-d08aca2b1184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb057384cf94a249c95fce8f7eff4e0'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.799942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1301/2659] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:23 2022] DELETE /identity/v3/users/7bb057384cf94a249c95fce8f7eff4e0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:23.980342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:23.991129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9eab9e-0721-412f-8399-5066af496899 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.048866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.049502 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.049788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.050067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] PATH_INFO: `/v3/projects/e5a4f659c0d743c692f99b38d953a197` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.051261 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a4f659c0d743c692f99b38d953a197)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.053223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.101269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a4f659c0d743c692f99b38d953a197', 'request_id': 'req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.107414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a4f659c0d743c692f99b38d953a197', 'request_id': 'req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.122865 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a4f659c0d743c692f99b38d953a197', 'request_id': 'req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.138102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] The token cache is being invalidate because project e5a4f659c0d743c692f99b38d953a197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:24.138423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.139092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-da43ad3d-92c0-4576-9b3a-96dd1f54f8f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.140647 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1359/2660] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:23 2022] DELETE /identity/v3/projects/e5a4f659c0d743c692f99b38d953a197 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:24.147070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.147897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.148526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.179832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.182042 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.259554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1302/2661] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:24.268296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.268625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.268930 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.290743 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.292155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.300461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1360/2662] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:24.304505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.320085 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b138be-90f6-4919-8236-77efecaf59fd None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.324789 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.326227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.326227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.326519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.327168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:24.327471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.329110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.341508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1303/2663] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:24.345914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.355482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae018cab-ea3f-4a5b-8031-98df1539ad17 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.360120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.360744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.361028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.361299 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.361921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.363868 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.392462 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1361/2664] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:24.396682 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.413523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cfcd25-1b70-46d3-99b0-7ee30616ceb4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.470121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.470726 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.471009 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.471280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.471904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.473841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.481542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:24.497892 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1304/2665] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:24.500653 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.510726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f7bbf-3dfe-41a3-9428-6de3545babbf admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.515796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.516406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.516692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.516966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.517620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.519319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.533756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1362/2666] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:24.537969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.548311 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ae58a-89c4-4116-b084-2d3cd98d5b53 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.552863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.553459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.553731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.553997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.554627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.556218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365ed2-2326-4a0c-85c6-ac1580b3dd1c admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.567192 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1305/2667] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:24.571244 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.581674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fd2390-fe13-4b59-ad9f-6ef227c556dd admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.586297 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.586938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.587215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.587489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] PATH_INFO: `/v3/projects/8227926c47dd449ca43188ba2a5b7e8a/users/136fae6b602946ac900e98e49ffc759c/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.603485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8227926c47dd449ca43188ba2a5b7e8a, user_id=136fae6b602946ac900e98e49ffc759c, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.606400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.618632 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1363/2668] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:24 2022] PUT /identity/v3/projects/8227926c47dd449ca43188ba2a5b7e8a/users/136fae6b602946ac900e98e49ffc759c/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:24.630344 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.630635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.630912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.658339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] MFA Rules not processed for user `136fae6b602946ac900e98e49ffc759c`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.659548 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.727717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1306/2669] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:24.732914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.745891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:24.795334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64d181-7a52-4065-828e-180ea50b4f15 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.800064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.800701 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.800985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.801262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.801885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.803800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.834577 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1364/2670] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:24.838984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.850079 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30fcbc3-97db-4756-940f-910e203842e4 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.907137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.907657 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.907932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.908202 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.908868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.910757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.932244 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1307/2671] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:24.936301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.947048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a78b81-340f-457a-a875-7fde2a7daf46 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.952107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.952892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.953173 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.953443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.954078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.955667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.966917 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1365/2672] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:24.971168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.981005 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03411c-b77a-4ed4-b9aa-0aa667f2b6f8 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.985643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.986291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.986600 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.986878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] PATH_INFO: `/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7/users/af21ca44a0514d8b8a351ba5ee20742b/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.001329 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5ad04de2a44290bfbcb94cb82d44b7, user_id=af21ca44a0514d8b8a351ba5ee20742b, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.003941 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.017322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1308/2673] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:24 2022] PUT /identity/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7/users/af21ca44a0514d8b8a351ba5ee20742b/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:25.021374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.032218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9394d-afbe-431c-829f-bb4d015c2735 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.088921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.089527 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.089813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.090089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.090817 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.092330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15393e3-4d04-49b7-a07e-7cb40c203b2b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.102053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1366/2674] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:06:25.107052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.117468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0cdd-a579-4643-87ec-8e16e25e07fe admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.122785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.123433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.123708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.123977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] PATH_INFO: `/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7/users/af21ca44a0514d8b8a351ba5ee20742b/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.125925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5ad04de2a44290bfbcb94cb82d44b7, user_id=af21ca44a0514d8b8a351ba5ee20742b, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.128572 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.138733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1309/2675] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:25 2022] PUT /identity/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7/users/af21ca44a0514d8b8a351ba5ee20742b/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:25.150483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.150766 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.151035 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.183895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] MFA Rules not processed for user `af21ca44a0514d8b8a351ba5ee20742b`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:25.186473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.261800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1367/2676] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:25.273115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.274883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.297936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:25.333391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e66c51-ca61-49e0-ab37-339a089f27fc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.337040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.337642 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.337920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.338193 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.347806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.349301 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e05d9b8-a15d-4ef1-a9ec-8b50063d4385 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.359188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1310/2677] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:25.434682 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.436222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.448432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c2c6f-4f25-44ae-8779-dd4df1f35c50 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.452827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.453506 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.453855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.454197 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.460250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:25.514330 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.515858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.524918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1368/2678] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:29.545396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab67af-28a1-499f-9d63-5a84cf016624 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.545985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab67af-28a1-499f-9d63-5a84cf016624 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.545985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab67af-28a1-499f-9d63-5a84cf016624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:29.565573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-05ab67af-28a1-499f-9d63-5a84cf016624 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:29.566787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-05ab67af-28a1-499f-9d63-5a84cf016624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:29.641978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1311/2679] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:29.668457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:29.670900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:29.749402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6fda18-9db8-44e7-b12e-e470eed9001e service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:29.755975 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:29.756633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.756914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.757182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:29.766155 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:29.767742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:29.777295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1369/2680] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:33.618347 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9143ca-83f0-485b-836e-95a4392bcacc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:33.618908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9143ca-83f0-485b-836e-95a4392bcacc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:33.618908 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9143ca-83f0-485b-836e-95a4392bcacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:33.638507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7c9143ca-83f0-485b-836e-95a4392bcacc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:33.639756 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7c9143ca-83f0-485b-836e-95a4392bcacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:33.647704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1312/2681] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:33.669664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:33.671133 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:33.688638 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a6f9-55c6-40ff-ae1d-3d9cc5082f5a service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:33.694898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:33.695504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:33.695785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:33.696059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:33.704441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:33.706008 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:33.716752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1370/2682] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:37.941647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a53c3-5354-407f-b1e3-578d155d53a0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:37.942158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a53c3-5354-407f-b1e3-578d155d53a0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:37.942268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a53c3-5354-407f-b1e3-578d155d53a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:37.962322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b54a53c3-5354-407f-b1e3-578d155d53a0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:37.963785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b54a53c3-5354-407f-b1e3-578d155d53a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:37.972416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1313/2683] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:37.997405 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:38.009341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89054820-ec32-4b50-8171-7a4a97930fbd service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:38.015943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:38.016722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:38.017129 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:38.017486 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:38.026361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:38.028023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:38.038240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1371/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:42.051218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2877-d2bd-44ca-a7a7-c1e451e14f63 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.051764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2877-d2bd-44ca-a7a7-c1e451e14f63 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.051764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2877-d2bd-44ca-a7a7-c1e451e14f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.072785 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-488e2877-d2bd-44ca-a7a7-c1e451e14f63 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:42.074662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-488e2877-d2bd-44ca-a7a7-c1e451e14f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:42.082833 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1314/2685] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:42.105414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:42.117947 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a1b66-abc2-4d94-b5c6-b1e8ce69356e service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:42.123969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:42.124604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.124891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.125167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.133870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:42.135443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:42.145135 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1372/2686] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:46.244008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5bb6-c3b0-48bd-85d6-c1dd08cb231f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:46.244609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5bb6-c3b0-48bd-85d6-c1dd08cb231f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:46.244609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5bb6-c3b0-48bd-85d6-c1dd08cb231f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:46.265871 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-27ef5bb6-c3b0-48bd-85d6-c1dd08cb231f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:46.267163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-27ef5bb6-c3b0-48bd-85d6-c1dd08cb231f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:46.275517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1315/2687] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:46.298873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:46.315741 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0116303-0cd5-4ad9-b8ab-810928c87f42 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:46.324618 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:46.325092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:46.325450 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:46.325646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:46.334709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:46.336363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:46.346959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1373/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:50.594391 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.594819 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.595068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.616613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:50.618013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:50.626684 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1316/2689] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:50.655848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:50.667062 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96e12b-feab-4213-88b7-e0b96337a5e1 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:50.672531 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:50.673121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.673397 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.673666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.681697 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:50.683279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:50.692684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1374/2690] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:53.759163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:53.772952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187acaf-0c46-48ba-bcfa-b0e0e84db701 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:53.776923 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:53.777558 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:53.777840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:53.778114 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:53.779878 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:53.793842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:53.795268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d09f5f1-779c-4cf9-9b10-93f158a06312 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:53.806285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1317/2691] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:55.992809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:55.997690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:56.004402 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbaaac7-7f47-4f85-927b-4b952023ea61 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:56.009215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:56.009839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:56.010148 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:56.010420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] PATH_INFO: `/v3/users/136fae6b602946ac900e98e49ffc759c` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:56.011534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136fae6b602946ac900e98e49ffc759c)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:56.013634 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:56.059924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136fae6b602946ac900e98e49ffc759c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.067012 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136fae6b602946ac900e98e49ffc759c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.074156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136fae6b602946ac900e98e49ffc759c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.074814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136fae6b602946ac900e98e49ffc759c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.086695 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136fae6b602946ac900e98e49ffc759c'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.093298 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1375/2692] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:55 2022] DELETE /identity/v3/users/136fae6b602946ac900e98e49ffc759c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:56.097804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:56.098355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:56.098461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:56.106080 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=66 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:56.118641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:56.119873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:56.184161 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1318/2693] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:56.190664 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:56.192103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:56.250913 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c55a-41d7-4df3-bf6b-533c530450d3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:56.254580 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:56.255184 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:56.255460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:56.255731 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:56.264615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:56.266045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:56.275364 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1376/2694] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:56.643987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:56.645564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:56.657830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccdff7-2a51-4642-86bc-d5c9de3680f8 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:56.662436 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:56.663059 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:56.663412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:56.663601 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] PATH_INFO: `/v3/projects/8227926c47dd449ca43188ba2a5b7e8a` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:56.664778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8227926c47dd449ca43188ba2a5b7e8a)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:56.666670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:56.714116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8227926c47dd449ca43188ba2a5b7e8a', 'request_id': 'req-83f6d28d-0caa-4faf-9093-66af04f200bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.719885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8227926c47dd449ca43188ba2a5b7e8a', 'request_id': 'req-83f6d28d-0caa-4faf-9093-66af04f200bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.727188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8227926c47dd449ca43188ba2a5b7e8a', 'request_id': 'req-83f6d28d-0caa-4faf-9093-66af04f200bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.738141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] The token cache is being invalidate because project 8227926c47dd449ca43188ba2a5b7e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:56.738428 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.739051 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.740557 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1319/2695] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:56 2022] DELETE /identity/v3/projects/8227926c47dd449ca43188ba2a5b7e8a => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:56.745009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:56.754711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85554b70-1a20-4868-9bf5-97df4c1f7213 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:56.810382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:56.811004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:56.811287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:56.811579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] PATH_INFO: `/v3/users/af21ca44a0514d8b8a351ba5ee20742b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:56.812702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af21ca44a0514d8b8a351ba5ee20742b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:56.814599 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:56.835571 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:56.861661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af21ca44a0514d8b8a351ba5ee20742b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.869014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af21ca44a0514d8b8a351ba5ee20742b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.876365 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af21ca44a0514d8b8a351ba5ee20742b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.877013 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af21ca44a0514d8b8a351ba5ee20742b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.890863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-d53786cb-88b2-489c-991c-02a91c394f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af21ca44a0514d8b8a351ba5ee20742b'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:56.896941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1377/2696] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:56 2022] DELETE /identity/v3/users/af21ca44a0514d8b8a351ba5ee20742b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:57.159934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.162383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.180060 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f6d28d-0caa-4faf-9093-66af04f200bd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.239342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.239983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.240262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.240575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] PATH_INFO: `/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.241713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5ad04de2a44290bfbcb94cb82d44b7)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.243612 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.275165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:57.292206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5ad04de2a44290bfbcb94cb82d44b7', 'request_id': 'req-cf821b90-917c-4207-ae44-3cc1d378bd34'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:57.297679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5ad04de2a44290bfbcb94cb82d44b7', 'request_id': 'req-cf821b90-917c-4207-ae44-3cc1d378bd34'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:57.304863 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5ad04de2a44290bfbcb94cb82d44b7', 'request_id': 'req-cf821b90-917c-4207-ae44-3cc1d378bd34'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:57.316555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] The token cache is being invalidate because project 8a5ad04de2a44290bfbcb94cb82d44b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:57.316847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:57.317483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-cf821b90-917c-4207-ae44-3cc1d378bd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:57.318964 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1320/2697] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:57 2022] DELETE /identity/v3/projects/8a5ad04de2a44290bfbcb94cb82d44b7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:57.325139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.325739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.325739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.345077 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:57.346286 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.404595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1378/2698] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:57.412479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.412768 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.413046 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.433957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:57.435162 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.443250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1321/2699] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:57.447860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.457729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b70736-c083-40af-b011-cd21fc6d6402 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.462565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.463665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.463943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.464213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.464900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:57.465202 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.466786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.478240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1379/2700] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:57.483012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.492492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b2ea0-1b59-4104-ae29-e12ef709c9ae None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.497514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.498111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.498389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.498661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.499285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.501195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.539277 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1322/2701] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:57.543932 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.555182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f803ef-92a6-48c1-95b2-e350148ab5e0 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.603382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.606907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.620866 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.621776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.622058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.622336 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.623272 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.627387 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.653262 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1380/2702] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:57.657414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.670431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab92f5b-0af8-4e74-a624-8527235286dc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.671090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17aa85b-8f4c-48b7-bc43-49cd571971b9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.674183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.674803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.675082 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.675356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.675835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.676497 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.676785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.677064 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.677420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.677714 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.679346 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.691353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1381/2703] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:57.695281 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.701003 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:57.706616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ebc22-e469-449b-96cf-eb12fa35162e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.714367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.715053 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.715393 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.715803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.716894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.718689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.733087 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1382/2704] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:06:57.734209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.744604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbd938-88e2-4bce-b7bd-ce3c847a5af5 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.749768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.750417 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.750699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.750979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] PATH_INFO: `/v3/projects/9cd3acb8afe24e2e8ef9c0fc0b8d01a9/users/702b2e78723a428fa99f69ba2ca8b0b6/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.769036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cd3acb8afe24e2e8ef9c0fc0b8d01a9, user_id=702b2e78723a428fa99f69ba2ca8b0b6, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.770450 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.771891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.772011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0136b-83ef-4d8f-b726-a9274db36b66 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.786905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1323/2705] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:06:57.788209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1383/2706] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:57 2022] PUT /identity/v3/projects/9cd3acb8afe24e2e8ef9c0fc0b8d01a9/users/702b2e78723a428fa99f69ba2ca8b0b6/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:57.800302 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.800798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.801084 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.831697 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] MFA Rules not processed for user `702b2e78723a428fa99f69ba2ca8b0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:57.833430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.843304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:57.900250 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1324/2707] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:57.911623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.913382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.974687 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f537f-9ee3-4fde-bf44-7c63da4cc16a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.978412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.979027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.979307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.979581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.989368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.990747 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986fe52d-756e-4147-89ae-56f704ff5d4a service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.999927 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1384/2708] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:03.453171 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:03.519592 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac637b9c-c252-4e79-b599-29effc33a4c0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:03.523518 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:03.524166 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:03.524480 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:03.524760 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] PATH_INFO: `/v3/users/702b2e78723a428fa99f69ba2ca8b0b6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:03.526394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702b2e78723a428fa99f69ba2ca8b0b6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:03.530271 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:03.581007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702b2e78723a428fa99f69ba2ca8b0b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:03.581771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702b2e78723a428fa99f69ba2ca8b0b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:03.590412 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702b2e78723a428fa99f69ba2ca8b0b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:03.598932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702b2e78723a428fa99f69ba2ca8b0b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:03.613696 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702b2e78723a428fa99f69ba2ca8b0b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:03.621406 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1325/2709] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:03 2022] DELETE /identity/v3/users/702b2e78723a428fa99f69ba2ca8b0b6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:03.626082 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:03.626708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:03.626821 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:03.647540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:03.648845 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:03.740478 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1385/2710] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:03.752020 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:03.753884 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:03.795465 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:03.823795 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9e5df-d164-4576-a0ad-1fd858a16745 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:03.827510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:03.828124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:03.828443 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:03.828792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:03.844124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:03.844124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db844031-14e2-42eb-bfcb-1bba0ed40c6d service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:03.850478 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1326/2711] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:04.140725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.142470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:04.155919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d1597-c62a-4072-abf7-f32465bac1f7 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.163689 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.164416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.164777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.165175 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] PATH_INFO: `/v3/projects/9cd3acb8afe24e2e8ef9c0fc0b8d01a9` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.167089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cd3acb8afe24e2e8ef9c0fc0b8d01a9)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.169037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.218269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cd3acb8afe24e2e8ef9c0fc0b8d01a9', 'request_id': 'req-876d72ba-081a-4490-b442-1e3429e52ecd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:04.223832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cd3acb8afe24e2e8ef9c0fc0b8d01a9', 'request_id': 'req-876d72ba-081a-4490-b442-1e3429e52ecd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:04.232753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cd3acb8afe24e2e8ef9c0fc0b8d01a9', 'request_id': 'req-876d72ba-081a-4490-b442-1e3429e52ecd'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:04.234091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:04.247401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] The token cache is being invalidate because project 9cd3acb8afe24e2e8ef9c0fc0b8d01a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:04.247694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:04.248514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-876d72ba-081a-4490-b442-1e3429e52ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:04.250488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1386/2712] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:04 2022] DELETE /identity/v3/projects/9cd3acb8afe24e2e8ef9c0fc0b8d01a9 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:04.256141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.256442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.256751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.276542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:04.277751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:04.334872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1327/2713] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:04.343407 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.343694 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.343990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.363753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:04.364999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:04.373524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1387/2714] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:04.377739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.387811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ed9cb-ea55-43ce-886f-8a989ff7767d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.392407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.393012 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.393288 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.393589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.394227 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:04.394532 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.396120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.408481 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1328/2715] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:04.412877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.422591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe288c3-3994-40e8-b3cc-380933410366 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.427327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.427948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.428233 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.428542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.429171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.431043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.459039 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1388/2716] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/projects => generated 367 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:04.464169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.474290 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee8355d-f547-4199-86b4-64aa65d1e5ad admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.531838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.532475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.532757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.533029 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.533651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.535551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.559142 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1329/2717] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:04.564611 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.575514 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf47b2-9207-41c9-9e48-1a5abcbe9d49 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.580153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.580781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.581059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.581326 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.581957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.583538 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.594193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1389/2718] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:04.598306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.608549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e664648-e730-4485-874d-be49541ff278 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.613531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.614128 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.614404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.614673 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.615309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.616924 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d5442-6707-41da-94f3-47c7eba0e4ad admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.627530 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1330/2719] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:04.631681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.642354 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9713560a-dcdf-4e86-be35-e6d590e40cd3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:04.647369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:04.648030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.648327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.648635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] PATH_INFO: `/v3/projects/f8a05fec83814bd480181435a57662c0/users/7c29b2cd9e69468d84cc23f252b3a401/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.786167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a05fec83814bd480181435a57662c0, user_id=7c29b2cd9e69468d84cc23f252b3a401, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:04.788856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:04.803220 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1390/2720] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:04 2022] PUT /identity/v3/projects/f8a05fec83814bd480181435a57662c0/users/7c29b2cd9e69468d84cc23f252b3a401/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:04.814913 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4c20-e040-4048-b28d-a920fe85c8b1 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.815266 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4c20-e040-4048-b28d-a920fe85c8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.815609 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b4c20-e040-4048-b28d-a920fe85c8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.846754 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-1f0b4c20-e040-4048-b28d-a920fe85c8b1 None None] MFA Rules not processed for user `7c29b2cd9e69468d84cc23f252b3a401`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:04.848057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-1f0b4c20-e040-4048-b28d-a920fe85c8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:04.880155 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:04.926049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1331/2721] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:04.937986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:04.939836 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:05.001188 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4acf79-6b32-44ee-98bd-52b04b2c87de admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:05.004725 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf080f10671b4fd8aaf6e232d5f8b2f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:05.005328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:05.005608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:05.005879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:05.014643 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:05.016059 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:05.025512 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1391/2722] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:07.217985 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:07.218865 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:07.219485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:07.246438 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] MFA Rules not processed for user `ebc58cc61d1e4b87a1882a4e9a8cc03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:07.247938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:07.327603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1332/2723] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:08.101154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:08.102584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:08.191991 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a033-2f79-4bb9-82b6-5449f50c89f0 service glance] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:08.197258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:08.197874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:08.198151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:08.198421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:08.200145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:08.214456 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:08.216067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:08.227826 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1392/2724] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:10.062655 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:10.064125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:10.121246 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ef33b4-51b4-4fed-bae5-36b18128905f None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:10.124972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:10.125525 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:10.135006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:10.135006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:10.135006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:10.138656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:10.140087 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:10.148116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1333/2725] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:13.390166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:13.390679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:13.402474 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a37962-a0bb-4e5e-a947-103138fd8e2c service placement] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:13.406015 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:13.406610 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:13.406883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:13.407147 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:13.408852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:13.432065 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:13.478058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:13.480055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:13.490723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1393/2726] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:17.110954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.112441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:17.135881 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958f8e5-10f5-4bc8-b17f-9815b7bcf303 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.140569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.141215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.141490 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.141764 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] PATH_INFO: `/v3/users/9986a3dc2450420abf8c260c4c8d109b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.142932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9986a3dc2450420abf8c260c4c8d109b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.144947 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.191797 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9986a3dc2450420abf8c260c4c8d109b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.192464 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9986a3dc2450420abf8c260c4c8d109b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.200157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9986a3dc2450420abf8c260c4c8d109b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.206965 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9986a3dc2450420abf8c260c4c8d109b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.212303 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:17.221846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e4563da2-2c69-4de1-b28e-8be5c6f0e727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9986a3dc2450420abf8c260c4c8d109b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.228337 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1334/2727] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:17 2022] DELETE /identity/v3/users/9986a3dc2450420abf8c260c4c8d109b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:17.441282 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.452839 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959cc1e-f5f8-499e-834c-a1945ab4c0b7 service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.517154 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.517796 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.518079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.518357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] PATH_INFO: `/v3/projects/da9fa408f8714e5ebdbbc2de123efc70` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.519476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9fa408f8714e5ebdbbc2de123efc70)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.521394 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.568782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9fa408f8714e5ebdbbc2de123efc70', 'request_id': 'req-68294c92-4b12-42de-bf32-404faf9aa465'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.574204 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9fa408f8714e5ebdbbc2de123efc70', 'request_id': 'req-68294c92-4b12-42de-bf32-404faf9aa465'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.582314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9fa408f8714e5ebdbbc2de123efc70', 'request_id': 'req-68294c92-4b12-42de-bf32-404faf9aa465'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.594251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] The token cache is being invalidate because project da9fa408f8714e5ebdbbc2de123efc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:17.594537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.595164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-68294c92-4b12-42de-bf32-404faf9aa465 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:17.596667 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1394/2728] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:17 2022] DELETE /identity/v3/projects/da9fa408f8714e5ebdbbc2de123efc70 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:17.601674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.601889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.602165 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.622065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:17.623260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:17.682665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1335/2729] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:17.692140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.692727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.693123 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.713919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:17.715143 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:17.723270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1395/2730] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:17.727644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.738158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789854ca-854c-4718-a5b6-a5b8a4f9d132 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.743275 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.743959 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.744987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.745267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.745904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:17.746203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.748613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.760135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1336/2731] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:17.764492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.777706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab89e3-3ba6-4c3e-bdcd-d86ae7abd000 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.783046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.783660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.783941 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.784216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.784889 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.786828 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.817125 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1396/2732] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:17 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:17.821718 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.832993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5845e96-f571-4018-89b5-a975b72e1804 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.898986 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.899599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.899876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.900170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.901485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.903362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.927384 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1337/2733] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:17 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:17.931498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.941969 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383612f2-adab-4aa6-86d7-32e5de678684 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.946820 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.947945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.948219 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.948558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.949195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.950762 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.961007 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1397/2734] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:17.966132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.976564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e79dc-7cf3-4806-8771-b79ff5785ef9 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.981180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.981779 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.982064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.982334 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.982974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.984610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8fcf8-ddd1-4c61-8542-5c1369b1551a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.995205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1338/2735] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:17.999363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:18.010482 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee3e5fc-6629-4968-9cd9-91afe80d347e admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:18.015119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:18.015778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.016055 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.016325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] PATH_INFO: `/v3/projects/2085632e17424c46be5bac2a3afabf51/users/2729205cbbec4902ab6710daa6d6ea11/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.018711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:18.034722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2085632e17424c46be5bac2a3afabf51, user_id=2729205cbbec4902ab6710daa6d6ea11, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:18.037420 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:18.050318 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1398/2736] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:17 2022] PUT /identity/v3/projects/2085632e17424c46be5bac2a3afabf51/users/2729205cbbec4902ab6710daa6d6ea11/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:18.062431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3998-44f9-4c7c-b179-7aa58a63fd13 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.062709 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3998-44f9-4c7c-b179-7aa58a63fd13 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.063000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff3998-44f9-4c7c-b179-7aa58a63fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.093178 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-b9ff3998-44f9-4c7c-b179-7aa58a63fd13 None None] MFA Rules not processed for user `2729205cbbec4902ab6710daa6d6ea11`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:18.094389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b9ff3998-44f9-4c7c-b179-7aa58a63fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:18.151410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:18.183280 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1339/2737] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:18.196283 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:18.198753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:18.284172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af773859-4616-40c4-be46-f569e9c0f2bc admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:18.290081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:18.290693 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.290995 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.291269 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.300151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:18.301786 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:18.311831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1399/2738] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:21.872076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:21.872651 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:21.872777 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:21.892625 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:21.893849 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:21.952421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1340/2739] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:21.971669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:21.983121 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49953702-8f8c-4022-bf4d-1f164d22624e service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:21.988605 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:21.989212 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:21.989461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:21.989729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:21.998627 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:22.000189 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24161664-6dae-44ab-8977-4c41da39d134 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:22.009814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1400/2740] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:24.662911 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:24.671714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849975-631e-4952-ad7c-1f9e8bc113e3 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:24.676872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:24.677637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.677989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.678331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] PATH_INFO: `/v3/users/2729205cbbec4902ab6710daa6d6ea11` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.679607 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2729205cbbec4902ab6710daa6d6ea11)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:24.681786 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:24.735983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2729205cbbec4902ab6710daa6d6ea11'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:24.736774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2729205cbbec4902ab6710daa6d6ea11'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:24.746058 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2729205cbbec4902ab6710daa6d6ea11'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:24.753758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2729205cbbec4902ab6710daa6d6ea11'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:24.766934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2729205cbbec4902ab6710daa6d6ea11'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:24.773339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1341/2741] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:24 2022] DELETE /identity/v3/users/2729205cbbec4902ab6710daa6d6ea11 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:24.778614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.779134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.779287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.801373 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:24.802616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:24.883832 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1401/2742] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:24.899463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:24.901666 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:24.968419 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8657bc-a619-4905-83ab-78b8fdc58210 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:24.972586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:24.973427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:24.973843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:24.974353 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:24.984276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:24.985731 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c37b08-e2db-46e4-8243-4af8d66d51fa service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:24.989751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:24.997574 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1342/2743] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:25.283967 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.285604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:25.299723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60874b-c3b1-49a6-951b-253083ff3be9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.304958 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.305593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.306379 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.306651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] PATH_INFO: `/v3/projects/2085632e17424c46be5bac2a3afabf51` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.307902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2085632e17424c46be5bac2a3afabf51)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.309899 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.358852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2085632e17424c46be5bac2a3afabf51', 'request_id': 'req-35fdf32a-a695-49ad-9c20-ef2997f09873'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:25.360068 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:25.365756 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2085632e17424c46be5bac2a3afabf51', 'request_id': 'req-35fdf32a-a695-49ad-9c20-ef2997f09873'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:25.375091 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2085632e17424c46be5bac2a3afabf51', 'request_id': 'req-35fdf32a-a695-49ad-9c20-ef2997f09873'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:25.388090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] The token cache is being invalidate because project 2085632e17424c46be5bac2a3afabf51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:25.388416 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:25.389086 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-35fdf32a-a695-49ad-9c20-ef2997f09873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:25.390732 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1402/2744] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:25 2022] DELETE /identity/v3/projects/2085632e17424c46be5bac2a3afabf51 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:25.396882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.397105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.397386 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.417331 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:25.418587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:25.478561 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1343/2745] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:25.486361 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.486669 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.486943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.506888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:25.508097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:25.517034 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1403/2746] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:25.521474 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.531812 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e136d1-552d-48ae-990a-98b3231b2c8c None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.536738 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.537352 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.537629 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.537899 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.538613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:25.538910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.540737 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.553862 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1344/2747] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:25.558702 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.568744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19b91d-d334-4d8f-8722-fc3869d03180 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.574145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.574744 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.575050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.575338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.575949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.577873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.607110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1404/2748] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:25 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:25.611900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.622641 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56df143-b88f-4ab4-b8fe-91871985d338 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.684704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.685510 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.685622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.685857 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.686488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.688427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.711649 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1345/2749] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:25 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:25.716067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.728778 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e512b44-be5a-4e72-8428-f1a333e75545 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.733334 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.733944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.734221 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.734493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.735139 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.736771 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.747912 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1405/2750] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:25.752467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.762662 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b31f4-8b80-4cfe-ab44-6e68619e5a73 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.767401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.767997 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.768276 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.768580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.769231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.770832 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c051ab78-3085-46f8-a44a-7eac0b978c09 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.781758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1346/2751] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:25.786490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.801631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3c0c7-cc66-4be3-a10e-5c5f4f264a95 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:25.807922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:25.808795 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.809203 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.809489 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] PATH_INFO: `/v3/projects/1dec2a9450c2450e9ea656279f87c240/users/6840b4ec51cc4bd6b83014b0be9b851e/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.824808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dec2a9450c2450e9ea656279f87c240, user_id=6840b4ec51cc4bd6b83014b0be9b851e, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:25.827443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:25.841360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1406/2752] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:25 2022] PUT /identity/v3/projects/1dec2a9450c2450e9ea656279f87c240/users/6840b4ec51cc4bd6b83014b0be9b851e/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:25.851877 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e075a-a9d6-48c5-b121-dfe28dba6402 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:25.852164 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e075a-a9d6-48c5-b121-dfe28dba6402 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:25.852466 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38e075a-a9d6-48c5-b121-dfe28dba6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:25.883354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d38e075a-a9d6-48c5-b121-dfe28dba6402 None None] MFA Rules not processed for user `6840b4ec51cc4bd6b83014b0be9b851e`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:25.884720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d38e075a-a9d6-48c5-b121-dfe28dba6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:25.950253 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:25.967425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1347/2753] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:25.976823 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:25.979209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.047401 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99650c-75cf-4b36-ab67-f0957e961c05 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:26.051874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:26.052595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.052901 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.053267 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.068358 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:26.070078 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:26.081623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1407/2754] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:26.219326 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2faf7-d1c3-4a23-b785-018e2e135ac8 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.219564 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2faf7-d1c3-4a23-b785-018e2e135ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.220578 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2faf7-d1c3-4a23-b785-018e2e135ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.244916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-47a2faf7-d1c3-4a23-b785-018e2e135ac8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:26.246186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-47a2faf7-d1c3-4a23-b785-018e2e135ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.310710 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1348/2755] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:26.333490 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:26.335090 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.441956 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a799379-31a7-4627-8c2d-f1f4fd42a62d service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:26.448776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:26.449434 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.449692 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.449965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.459813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:26.461783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:26.472966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1408/2756] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:30.324873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374479a-bccb-4614-959a-933477c49de0 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:30.325355 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374479a-bccb-4614-959a-933477c49de0 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:30.325496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9374479a-bccb-4614-959a-933477c49de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:30.346748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-9374479a-bccb-4614-959a-933477c49de0 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:30.347951 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-9374479a-bccb-4614-959a-933477c49de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:30.359463 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1349/2757] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:07:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:30.381533 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:30.382946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:30.394010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:30.404164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b596085-c20e-4065-b2e2-18e4e33614c3 service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:30.409162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:30.409768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:30.410043 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:30.410312 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:30.419389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:30.421146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc859ff-f491-4e4a-87e9-91b1a7de7630 service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:30.431225 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1409/2758] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:32.203260 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374479a-bccb-4614-959a-933477c49de0 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:32.220423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9374479a-bccb-4614-959a-933477c49de0 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:32.229018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:32.229704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:32.229991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:32.230267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:32.232497 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:32.251366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:32.254251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:32.275683 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1350/2759] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:34.646500 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:34.646996 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:34.647110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:34.668156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:34.669440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:34.677940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1410/2760] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:34.703630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:34.717008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed6782-415d-43c2-bc64-1bffbf9ff7c4 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:34.724068 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:34.724840 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:34.725125 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:34.725426 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:34.734920 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:34.736803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ea46a9-e749-4226-a6e3-16071cc49b0e service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:34.748319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1351/2761] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:34.848214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:34.858710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408aa6f8-c09a-4f92-895e-8d9fec39b4f5 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:34.863621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:34.864436 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:34.864718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:34.865447 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] PATH_INFO: `/v3/users/6840b4ec51cc4bd6b83014b0be9b851e` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:34.866159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6840b4ec51cc4bd6b83014b0be9b851e)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:34.868177 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:34.943968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6840b4ec51cc4bd6b83014b0be9b851e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:34.953421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6840b4ec51cc4bd6b83014b0be9b851e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:34.960558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6840b4ec51cc4bd6b83014b0be9b851e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:34.962019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6840b4ec51cc4bd6b83014b0be9b851e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:34.975419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6840b4ec51cc4bd6b83014b0be9b851e'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:34.981810 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1411/2762] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:34 2022] DELETE /identity/v3/users/6840b4ec51cc4bd6b83014b0be9b851e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:34.986368 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:34.986656 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:34.986934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.007007 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:35.008340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:35.072707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1352/2763] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:35.083083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.084879 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:35.143801 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe96e3a-b58e-47a3-86b0-75f20f2151c1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.147581 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.148169 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.148485 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.148763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.157729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.159198 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caffb77a-ff9d-423f-b4d1-adfb4cf3b80a service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.168626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1412/2764] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:35.447473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.449665 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:35.470116 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5395-6ba5-4557-8fd3-c784b9be2328 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.476348 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.477774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.477934 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.478214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] PATH_INFO: `/v3/projects/1dec2a9450c2450e9ea656279f87c240` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.479381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dec2a9450c2450e9ea656279f87c240)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.481445 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.549679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dec2a9450c2450e9ea656279f87c240', 'request_id': 'req-04c66575-9e6c-4ec5-9063-9b26a807331a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:35.554885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:35.556826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dec2a9450c2450e9ea656279f87c240', 'request_id': 'req-04c66575-9e6c-4ec5-9063-9b26a807331a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:35.565689 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dec2a9450c2450e9ea656279f87c240', 'request_id': 'req-04c66575-9e6c-4ec5-9063-9b26a807331a'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:35.576917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] The token cache is being invalidate because project 1dec2a9450c2450e9ea656279f87c240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:35.577203 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:35.577828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-04c66575-9e6c-4ec5-9063-9b26a807331a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:35.579304 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1353/2765] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:35 2022] DELETE /identity/v3/projects/1dec2a9450c2450e9ea656279f87c240 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:35.584488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.584783 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.585048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.604564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:35.605752 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:35.656331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:35.668201 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1413/2766] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:35.677181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.677468 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.677745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.698667 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:35.699814 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:35.708066 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1354/2767] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:35.713208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.723014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a551f0b-e81f-470c-9f54-61503167fd0e None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.728593 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.729216 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.729496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.729770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.730421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:35.730722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.733423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.746019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1414/2768] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:35.750340 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.759887 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efccee-ea04-4c99-9b59-3f788ee043bb None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.764524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.765122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.765401 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.765681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.766310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.768948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.797690 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1355/2769] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:35 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:35.801918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.811977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe20ef-7814-4288-86cb-d8469f2209e3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.869888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.870501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.870780 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.871056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.871673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.873622 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.895304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1415/2770] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:35 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:35.900221 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.911442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a382a71-0a21-4c9f-9940-f1bd10365eb7 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.918119 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.918842 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.919181 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.919519 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.920235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.921907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.933172 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1356/2771] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:35.937328 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.947321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82839bff-6e4d-4ca6-a863-4042cea04bea admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.952130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.952709 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.953032 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.953302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:35.954009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:35.955585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63deee00-e1ca-4e70-b033-5cfbbf8bd4c9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:35.967084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1416/2772] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:35.971403 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:35.982000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acc953-f1e1-425e-b618-96ed28454c6b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:35.986901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:35.987654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:35.987937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:35.988216 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] PATH_INFO: `/v3/projects/64745f941f104610bdd212ab5b2b17bd/users/9636a44f657f4f6c8a86f08e35efd966/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.006358 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64745f941f104610bdd212ab5b2b17bd, user_id=9636a44f657f4f6c8a86f08e35efd966, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.009103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.024919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1357/2773] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:35 2022] PUT /identity/v3/projects/64745f941f104610bdd212ab5b2b17bd/users/9636a44f657f4f6c8a86f08e35efd966/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:36.035788 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.036084 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.036406 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.065870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] MFA Rules not processed for user `9636a44f657f4f6c8a86f08e35efd966`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:36.067095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.136548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1417/2774] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:36.148143 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.150714 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.239559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e0dbe9-c287-49d2-b90f-f3ed8793b7f2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.245844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.246460 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.246745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.247023 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.260637 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.262679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.274828 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1358/2775] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:36.490481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.542718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:36.555573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de011bde-0093-443f-b6c2-b54f21ef0595 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.560553 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.561222 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.561735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.562009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] PATH_INFO: `/v3/users/9636a44f657f4f6c8a86f08e35efd966` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.564341 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9636a44f657f4f6c8a86f08e35efd966)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.566321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.578041 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.579586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.594061 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf38c19d-312e-47af-be99-a7a646d497a2 service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.599237 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.599889 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.600170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.600473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] PATH_INFO: `/v3/users/7c29b2cd9e69468d84cc23f252b3a401` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.601838 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c29b2cd9e69468d84cc23f252b3a401)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.604761 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.621374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9636a44f657f4f6c8a86f08e35efd966'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.632637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9636a44f657f4f6c8a86f08e35efd966'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.642501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9636a44f657f4f6c8a86f08e35efd966'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.643238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9636a44f657f4f6c8a86f08e35efd966'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.657229 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-ef16c2cd-a270-47d8-b9ac-c43d38de6ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9636a44f657f4f6c8a86f08e35efd966'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.660110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c29b2cd9e69468d84cc23f252b3a401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.660868 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c29b2cd9e69468d84cc23f252b3a401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.669460 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1418/2776] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:36 2022] DELETE /identity/v3/users/9636a44f657f4f6c8a86f08e35efd966 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:36.673282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c29b2cd9e69468d84cc23f252b3a401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.675006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.675327 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.675607 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.681270 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:36.684423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c29b2cd9e69468d84cc23f252b3a401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.701459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-913a599b-f55c-4c66-9b17-60372cc54f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c29b2cd9e69468d84cc23f252b3a401'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.701952 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:36.703165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.708014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1359/2777] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:36 2022] DELETE /identity/v3/users/7c29b2cd9e69468d84cc23f252b3a401 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:36.712685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.713300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.713300 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.731681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:36.732870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.767014 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1419/2778] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:36.776994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.778495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.795943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1360/2779] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:36.805903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.807339 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.837098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f5976-1cbe-4869-89a5-782a7d2c0b4a None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.863860 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:36.864811 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d27cc-a44c-454e-9a92-af36325e7569 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.869575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.870231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.870614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.870886 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.881183 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.882643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.891409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.892023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.892314 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.892621 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.893735 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1361/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:36.902598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.904074 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.915072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1420/2781] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:37.363707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.365174 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.369657 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.372196 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.390126 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f37202-d53c-4183-974a-ad41416db180 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.395968 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.396855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.397224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.397712 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] PATH_INFO: `/v3/projects/f8a05fec83814bd480181435a57662c0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.399589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a05fec83814bd480181435a57662c0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.399980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43efde4-3920-4c79-ac09-4682221308fb service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.405208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.405846 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.406126 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.406423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] PATH_INFO: `/v3/projects/64745f941f104610bdd212ab5b2b17bd` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.407532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64745f941f104610bdd212ab5b2b17bd)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.409566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.410437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.461120 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64745f941f104610bdd212ab5b2b17bd', 'request_id': 'req-77edb236-c4b7-49a6-9c3c-768fe2abf791'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.463392 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a05fec83814bd480181435a57662c0', 'request_id': 'req-faab7084-c0af-4a40-a05d-4e234a105671'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.467421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64745f941f104610bdd212ab5b2b17bd', 'request_id': 'req-77edb236-c4b7-49a6-9c3c-768fe2abf791'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.469269 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a05fec83814bd480181435a57662c0', 'request_id': 'req-faab7084-c0af-4a40-a05d-4e234a105671'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.475048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64745f941f104610bdd212ab5b2b17bd', 'request_id': 'req-77edb236-c4b7-49a6-9c3c-768fe2abf791'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.477477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a05fec83814bd480181435a57662c0', 'request_id': 'req-faab7084-c0af-4a40-a05d-4e234a105671'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.486711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] The token cache is being invalidate because project 64745f941f104610bdd212ab5b2b17bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:37.487240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.488049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-77edb236-c4b7-49a6-9c3c-768fe2abf791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.489718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1421/2782] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:37 2022] DELETE /identity/v3/projects/64745f941f104610bdd212ab5b2b17bd => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:37.494070 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] The token cache is being invalidate because project f8a05fec83814bd480181435a57662c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:37.494477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe3ba-26ec-41df-b66f-7448b7f1c72f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.494603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.495017 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe3ba-26ec-41df-b66f-7448b7f1c72f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.495243 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-faab7084-c0af-4a40-a05d-4e234a105671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:37.495613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe3ba-26ec-41df-b66f-7448b7f1c72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.496958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1362/2783] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:37 2022] DELETE /identity/v3/projects/f8a05fec83814bd480181435a57662c0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:37.501296 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3bc3-97a6-4497-9147-88e3ddd58714 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.501577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3bc3-97a6-4497-9147-88e3ddd58714 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.501969 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb3bc3-97a6-4497-9147-88e3ddd58714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.512792 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.520575 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-a2dfe3ba-26ec-41df-b66f-7448b7f1c72f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.521833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-a2dfe3ba-26ec-41df-b66f-7448b7f1c72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.530226 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3eeb3bc3-97a6-4497-9147-88e3ddd58714 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.531554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3eeb3bc3-97a6-4497-9147-88e3ddd58714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.594639 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1422/2784] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:37.602635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.603535 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.603848 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.611001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1363/2785] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:37.619622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.619910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.620186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.625400 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.626609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.636679 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1423/2786] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:37.640835 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.645360 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.646628 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.651509 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ba234-8ddf-4328-88c3-a8cf79bf8df6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.655001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1364/2787] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:37.656595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.657194 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.657479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.658024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.658526 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:37.658834 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.659052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.660438 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.668752 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e82eda-eb56-4559-9672-a34824d6d104 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.673399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1424/2788] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:07:37.675570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.676179 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.676483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.677024 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.677674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:37.677972 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.679627 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.681579 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.691176 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4d97-d36f-43d2-a3c0-2ff1c12ff80f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.697238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1365/2789] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:07:37.697928 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.698525 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.698808 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.699079 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.699539 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.699688 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.701625 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.709952 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b018d-4b27-4212-8085-550b671a5020 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.714791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.715390 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.715640 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.715906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.716633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.718500 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.733944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1425/2790] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:37.735117 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.750427 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.804408 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f85d6d-b780-47a9-bbc0-17500548845a admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.809654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.810273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.810548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.810819 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.811444 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.813558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.838248 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1426/2791] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/users => generated 283 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:37.842362 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.853950 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475ee54-1fb8-49d5-8779-d3c79a3266e6 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.859768 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.860591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.860800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.861214 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.861712 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.863320 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.869322 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1366/2792] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:37.873555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.876943 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1427/2793] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:37.878772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.892036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cd98bb-110a-4e92-9d20-7d5e32a74079 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.944090 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b7f44-a81e-4280-a87c-39cf538ba862 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.949633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.950239 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.950511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.950783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.951396 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.953314 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.956981 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.957590 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.957873 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.958150 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.958785 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.960369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.971023 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1428/2794] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:37.974937 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1367/2795] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:37.975145 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.979599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.985637 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcff9dd1-b090-4774-86bd-810626ab0723 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.990427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0764d5-3a1a-49c5-802f-358a62b0242b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.990594 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.991190 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.991483 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.991763 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] PATH_INFO: `/v3/projects/0e8ce15a5e194bd4bfa2c72787cd37b3/users/67e6734010544951b4f4ba904b0d801d/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.995516 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.996105 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.996378 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.996674 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.997306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.998882 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.008051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e8ce15a5e194bd4bfa2c72787cd37b3, user_id=67e6734010544951b4f4ba904b0d801d, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.008826 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1368/2796] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:38.010874 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34be7d0c-762e-45b7-875b-fc1f8951c03e admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.012803 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.022654 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72524c1-e3a3-4dd7-a0d9-7911b1a78d37 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.025814 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1429/2797] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:37 2022] PUT /identity/v3/projects/0e8ce15a5e194bd4bfa2c72787cd37b3/users/67e6734010544951b4f4ba904b0d801d/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:38.037323 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.037604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.037878 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.064586 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.065685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] MFA Rules not processed for user `67e6734010544951b4f4ba904b0d801d`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:38.066921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.082717 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.083410 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.083686 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.083954 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.084624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.086458 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.096554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1369/2798] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:38.100616 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.111855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb2cd8-a7c9-4fcc-882e-4538c1c0e1c4 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.116722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.117376 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.118285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.118560 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] PATH_INFO: `/v3/projects/76b48038faf74cb69805e4fe2e815310/users/7b633275423749bebf89a54311621a10/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.128552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.135701 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76b48038faf74cb69805e4fe2e815310, user_id=7b633275423749bebf89a54311621a10, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.138962 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fad22-9ae6-4970-9532-49fe5869bd65 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.142140 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1430/2799] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:38.147215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.153569 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1370/2800] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:38 2022] PUT /identity/v3/projects/76b48038faf74cb69805e4fe2e815310/users/7b633275423749bebf89a54311621a10/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:38.162552 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acde73-a008-4b0f-bdb9-e6250a79361f None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.164898 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.165185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.165454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.193999 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] MFA Rules not processed for user `7b633275423749bebf89a54311621a10`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:38.195224 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.218870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.219488 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.219772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.220049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.220713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.222656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.253572 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1431/2801] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:38 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:38.254603 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.265310 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1371/2802] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:38.276638 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.278112 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.319561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e3866-a0d9-4018-ba56-f921687dbc79 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.323939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.324583 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.324863 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.325172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.325750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.327660 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.334678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa325bcf-a69c-45d3-aab9-e3f65f325987 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.349620 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1432/2803] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:38 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:38.353728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.363690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183782c-1ca6-4d64-aacf-0a8bcabe00d1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.369781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.370628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.371038 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.371432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.372183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.374095 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.386635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.387421 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.387872 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.389048 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.389287 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1433/2804] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:38.393187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.405948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.410813 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f306b-58fc-4b2e-811f-f968028e4219 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.416905 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.417557 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.417833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.418103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] PATH_INFO: `/v3/projects/61c53330293c4abc8fd4d785bfa83031/users/c1a56d40e69d4245b8506b84304826c6/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.434322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c53330293c4abc8fd4d785bfa83031, user_id=c1a56d40e69d4245b8506b84304826c6, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.436997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.450908 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1434/2805] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:38 2022] PUT /identity/v3/projects/61c53330293c4abc8fd4d785bfa83031/users/c1a56d40e69d4245b8506b84304826c6/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:38.454815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.454982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.456546 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.466804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1372/2806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:38.492678 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.523515 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290f0ec-4c0e-4910-954b-d37c4f31af53 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.529094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.529710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.529990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.530263 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.530921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.532519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92114da8-ad5d-4734-bd6a-0c19c0dcb0a5 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.546441 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1435/2807] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:38.547580 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.558821 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76966841-fb60-4225-8adb-0524b27c93a9 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.563354 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.564356 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.564514 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.564778 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] PATH_INFO: `/v3/projects/61c53330293c4abc8fd4d785bfa83031/users/c1a56d40e69d4245b8506b84304826c6/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.566675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c53330293c4abc8fd4d785bfa83031, user_id=c1a56d40e69d4245b8506b84304826c6, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.569834 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.580711 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1373/2808] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:38 2022] PUT /identity/v3/projects/61c53330293c4abc8fd4d785bfa83031/users/c1a56d40e69d4245b8506b84304826c6/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:38.591713 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580056-c225-4974-bb1e-405734e06d29 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.591998 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580056-c225-4974-bb1e-405734e06d29 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.592273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580056-c225-4974-bb1e-405734e06d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.621480 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-69580056-c225-4974-bb1e-405734e06d29 None None] MFA Rules not processed for user `c1a56d40e69d4245b8506b84304826c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:38.622654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-69580056-c225-4974-bb1e-405734e06d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.712472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1436/2809] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:38.724416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.801977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c8c7cc-5083-4921-b66a-a89d15038c66 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.801977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.801977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.801977 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.802906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.809593 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.811291 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf0e4-fce7-41e4-9a85-8a1e8519beea service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.822681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1374/2810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:38.924984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580056-c225-4974-bb1e-405734e06d29 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.926409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-69580056-c225-4974-bb1e-405734e06d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.937963 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580056-c225-4974-bb1e-405734e06d29 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.941824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.942418 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.942699 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.942965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:39.001680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:39.003122 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:39.023089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1437/2811] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:39.816212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89489-e528-4cfa-8266-5f056fd3945f None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:39.816212 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89489-e528-4cfa-8266-5f056fd3945f None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:39.816874 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb89489-e528-4cfa-8266-5f056fd3945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:39.838195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-cdb89489-e528-4cfa-8266-5f056fd3945f None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:39.839359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-cdb89489-e528-4cfa-8266-5f056fd3945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:39.903488 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1375/2812] 10.222.0.47 () {58 vars in 1016 bytes} [Thu Aug 25 03:07:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:39.927156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:39.928869 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:40.032596 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=100 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:40.069071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074cd9-c88a-4ee2-9b5f-6deb7e6f836d service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:40.093368 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:40.094146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:40.094532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:40.094915 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:40.108253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:40.110016 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:40.123049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1438/2813] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:42.309691 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.310141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.310238 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.361095 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:42.362306 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.374918 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:42.452115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1376/2814] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:42.504574 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:42.506102 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.603192 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15323242-10d8-4b40-97e1-6186ff33f3db service nova] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:42.608321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:42.608961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.609241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.609516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.618111 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:42.619708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea53d06-f55e-4e2c-b20c-b336c13e6584 service swift] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:42.627994 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1439/2815] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:07:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:07:46.500200 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.518254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc5ae62-90ea-4d3d-9cd4-51060de2c65b None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.524006 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.524932 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.525278 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.525943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] PATH_INFO: `/v3/users/67e6734010544951b4f4ba904b0d801d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.526762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e6734010544951b4f4ba904b0d801d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.528771 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.606577 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e6734010544951b4f4ba904b0d801d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:46.607437 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e6734010544951b4f4ba904b0d801d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:46.621268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e6734010544951b4f4ba904b0d801d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:46.630614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e6734010544951b4f4ba904b0d801d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:46.643369 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e6734010544951b4f4ba904b0d801d'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:46.650670 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1377/2816] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:46 2022] DELETE /identity/v3/users/67e6734010544951b4f4ba904b0d801d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:46.657325 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.658199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.658665 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.681765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:46.682972 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:46.746307 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1440/2817] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:46.756295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.758524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:46.866743 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aeb48-eb4f-47e7-8450-f20efd2379aa admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.873454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.874206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.874511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.874926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.887188 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.889251 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.903570 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1378/2818] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:47.217355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:47.219081 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:47.233722 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177e89bf-ddda-4943-854e-1609831e5d80 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:47.240046 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:47.240854 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:47.241230 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:47.241598 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] PATH_INFO: `/v3/projects/0e8ce15a5e194bd4bfa2c72787cd37b3` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:47.243677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e8ce15a5e194bd4bfa2c72787cd37b3)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:47.246200 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:47.302279 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:47.308757 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e8ce15a5e194bd4bfa2c72787cd37b3', 'request_id': 'req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.315626 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e8ce15a5e194bd4bfa2c72787cd37b3', 'request_id': 'req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.324922 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e8ce15a5e194bd4bfa2c72787cd37b3', 'request_id': 'req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.339119 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] The token cache is being invalidate because project 0e8ce15a5e194bd4bfa2c72787cd37b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:47.339411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.340558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.342980 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1441/2819] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:47 2022] DELETE /identity/v3/projects/0e8ce15a5e194bd4bfa2c72787cd37b3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:47.347157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:47.358242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d8d54-88bd-4014-8dfa-b897e00c5dbb service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:47.389782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:47.426362 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:47.426993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:47.427264 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:47.427531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] PATH_INFO: `/v3/users/c1a56d40e69d4245b8506b84304826c6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:47.429261 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a56d40e69d4245b8506b84304826c6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:47.431152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:47.477479 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a56d40e69d4245b8506b84304826c6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.478121 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a56d40e69d4245b8506b84304826c6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.485599 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a56d40e69d4245b8506b84304826c6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.492643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a56d40e69d4245b8506b84304826c6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.505400 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9dc0cd7d-3b7f-4194-9a8c-b28241d87057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a56d40e69d4245b8506b84304826c6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:47.512097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1379/2820] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:47 2022] DELETE /identity/v3/users/c1a56d40e69d4245b8506b84304826c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:47.900439 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:47.902501 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:47.926353 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a576c42-36aa-4e39-a0f4-f43bdec4a76f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:47.995753 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:47.996426 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:47.996710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:47.996982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] PATH_INFO: `/v3/projects/61c53330293c4abc8fd4d785bfa83031` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:47.998115 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c53330293c4abc8fd4d785bfa83031)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.000071 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.081413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c53330293c4abc8fd4d785bfa83031', 'request_id': 'req-af587270-41b6-4203-b624-c8b694d41876'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:48.102413 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c53330293c4abc8fd4d785bfa83031', 'request_id': 'req-af587270-41b6-4203-b624-c8b694d41876'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:48.112092 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c53330293c4abc8fd4d785bfa83031', 'request_id': 'req-af587270-41b6-4203-b624-c8b694d41876'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:48.131161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] The token cache is being invalidate because project 61c53330293c4abc8fd4d785bfa83031 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:48.131615 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:48.133231 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-af587270-41b6-4203-b624-c8b694d41876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:48.135236 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1442/2821] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:47 2022] DELETE /identity/v3/projects/61c53330293c4abc8fd4d785bfa83031 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:48.140342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.140961 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.141235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.162475 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:48.163762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:48.232365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1380/2822] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:48.242674 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.242955 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.243232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.274423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:48.275650 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:48.284683 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1443/2823] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:48.288782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.298983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8540e70e-2779-4e7a-a095-d04791d3e1aa None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.305049 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.305702 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.305981 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.306248 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.306922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:48.307218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.308925 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.323614 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1381/2824] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:07:48.327916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.343746 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469ef76-86cf-4717-a243-5ae66773d9a8 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.349961 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.350856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.351205 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.351601 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.352484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.355700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.395718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1444/2825] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:48.397315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.411014 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0178b911-5f23-4946-bcc6-0798f843f30b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.454471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:48.485622 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.486231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.486505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.486805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.487418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.490000 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.520416 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1382/2826] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:48.522185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.535199 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be84fbdc-3d39-40cc-907b-3673f36ca3a3 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.542428 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.543045 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.544472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.544751 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.545404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.547076 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.565022 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1445/2827] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:48.566611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.578010 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12752ec2-750f-4856-a966-4d667c4be31b admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.583385 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.584065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.584424 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.584769 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.585766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.587433 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766b125-73e1-4344-a07c-2d4db735166e admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.603413 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1383/2828] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:48.604964 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.620072 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cd0cf-6511-421a-a635-d98e1984a8e9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.625534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.626473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.626739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.627010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] PATH_INFO: `/v3/projects/7eec2a4f38e544cea8585cb0401ce7ef/users/c3d50fe7a323482db534f06b7711ee3b/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.642461 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eec2a4f38e544cea8585cb0401ce7ef, user_id=c3d50fe7a323482db534f06b7711ee3b, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.645136 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.654775 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:48.665363 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1446/2829] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:48 2022] PUT /identity/v3/projects/7eec2a4f38e544cea8585cb0401ce7ef/users/c3d50fe7a323482db534f06b7711ee3b/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:48.674395 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.674901 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.675242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.707730 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] MFA Rules not processed for user `c3d50fe7a323482db534f06b7711ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:48.709013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:48.778257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1384/2830] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:48.782513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.871469 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e80638-5aa7-4770-a26e-cd1ea3945e60 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.876138 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.876769 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.877047 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.877316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.877940 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.880739 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:48.917624 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1447/2831] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/projects => generated 365 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:48.922512 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:48.936194 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7654da7a-7b00-45eb-9807-7191c4928b58 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:48.994816 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:48.995431 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:48.995707 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:48.995978 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:48.996658 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:48.998553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.019524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1385/2832] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:48 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:49.023973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.035565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f2ed4-760a-4794-8412-22494e0fd692 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.040855 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.041457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.041735 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.042006 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.042635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.044215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.054748 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1448/2833] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:49.059267 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.070836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bdc7c9-50a9-4cfb-8db6-a548e12a5a08 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.075487 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.076137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.076435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.076713 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] PATH_INFO: `/v3/projects/cda6346e728d4e898cffc90d51dbcd2f/users/58bd6d5c9c3040168d5407e7d1224e9c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.092430 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda6346e728d4e898cffc90d51dbcd2f, user_id=58bd6d5c9c3040168d5407e7d1224e9c, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.095057 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.117784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1386/2834] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:49 2022] PUT /identity/v3/projects/cda6346e728d4e898cffc90d51dbcd2f/users/58bd6d5c9c3040168d5407e7d1224e9c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:49.120645 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.126503 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.128477 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:49.133104 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef43e206-4342-489c-a04e-2606ddc86fbe admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.146092 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:49.203833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.204973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.205258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.205534 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.206182 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.207782 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.208045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48a493-4739-4ace-9939-61e72330fe5a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.213805 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.214555 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.214837 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.215122 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] PATH_INFO: `/v3/users/7b633275423749bebf89a54311621a10` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.216454 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b633275423749bebf89a54311621a10)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.219282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.220156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1449/2835] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:49.223853 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.235870 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c3a6-f474-4e56-ba35-e1305f9cc60c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.242774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.243703 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.244083 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.244496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] PATH_INFO: `/v3/projects/cda6346e728d4e898cffc90d51dbcd2f/users/58bd6d5c9c3040168d5407e7d1224e9c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.247452 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda6346e728d4e898cffc90d51dbcd2f, user_id=58bd6d5c9c3040168d5407e7d1224e9c, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.252010 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63e341-4f9c-4ba5-bea1-611a8e95a648 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.268242 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1450/2836] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:49 2022] PUT /identity/v3/projects/cda6346e728d4e898cffc90d51dbcd2f/users/58bd6d5c9c3040168d5407e7d1224e9c/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:49.281777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.282167 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.284066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.287372 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b633275423749bebf89a54311621a10'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:49.288757 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b633275423749bebf89a54311621a10'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:49.303722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b633275423749bebf89a54311621a10'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:49.317254 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b633275423749bebf89a54311621a10'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:49.338020 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] MFA Rules not processed for user `58bd6d5c9c3040168d5407e7d1224e9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:49.339883 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:49.351242 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-9532c4a7-c501-4b81-b725-100c06d69c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b633275423749bebf89a54311621a10'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:49.376064 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1387/2837] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:49 2022] DELETE /identity/v3/users/7b633275423749bebf89a54311621a10 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:49.384333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.384333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.384333 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.416984 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:49.418938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:49.438859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:49.500445 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1451/2838] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:49.517452 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1388/2839] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:49.518774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.520524 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:49.537979 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.541603 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:49.604885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:49.614537 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f78812f-1355-49bb-8336-dd96e4567b9b None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.639137 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1bbb3-cefc-484b-9adf-f0634c54493d None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.643247 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.643982 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.644357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.644766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.656856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.659071 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.678739 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1389/2840] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:49.689319 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.690815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.692146 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.692655 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:49.809495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:49.810877 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:49.833164 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1452/2841] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:49.968103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:49.990879 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07fe548-cbbd-4a33-9df9-f851857789aa service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:49.996900 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:49.997626 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:49.999018 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:49.999387 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.001563 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.082364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.085716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.110549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1390/2842] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:50.186681 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.190048 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.209383 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d7aa2-8cf1-4d22-a936-a2350b04b4d6 service cinder] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.227495 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.228357 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.228827 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.229278 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] PATH_INFO: `/v3/projects/76b48038faf74cb69805e4fe2e815310` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.230831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76b48038faf74cb69805e4fe2e815310)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.232990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.302493 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:50.317565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76b48038faf74cb69805e4fe2e815310', 'request_id': 'req-40160a55-ab22-409e-9a04-95547e75e00a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.324209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76b48038faf74cb69805e4fe2e815310', 'request_id': 'req-40160a55-ab22-409e-9a04-95547e75e00a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.333609 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76b48038faf74cb69805e4fe2e815310', 'request_id': 'req-40160a55-ab22-409e-9a04-95547e75e00a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.334289 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.337794 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.348473 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] The token cache is being invalidate because project 76b48038faf74cb69805e4fe2e815310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:50.348777 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.349558 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-40160a55-ab22-409e-9a04-95547e75e00a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.351492 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1453/2843] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:50 2022] DELETE /identity/v3/projects/76b48038faf74cb69805e4fe2e815310 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:50.356317 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c19a1-5951-40e0-bf74-5464aa096db3 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.356628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c19a1-5951-40e0-bf74-5464aa096db3 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.356902 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5c19a1-5951-40e0-bf74-5464aa096db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.364770 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bee0e-6692-4616-8738-7eac75220b09 service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.378304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-af5c19a1-5951-40e0-bf74-5464aa096db3 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:50.379597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-af5c19a1-5951-40e0-bf74-5464aa096db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.447511 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.448167 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.448483 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.448904 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] PATH_INFO: `/v3/users/da26b45ec5fb4e08bc370b1482902ed6` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.449170 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1454/2844] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:50.450074 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=da26b45ec5fb4e08bc370b1482902ed6)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.452091 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.456886 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.457258 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.457523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.478157 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:50.479337 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.489050 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1455/2845] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:50.493466 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.502324 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5e4aa-93bc-4c90-a000-2f26f8e5f88d None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.503389 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da26b45ec5fb4e08bc370b1482902ed6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.504140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da26b45ec5fb4e08bc370b1482902ed6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.507215 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.507811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.508116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.508544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.509191 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:50.509521 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.511730 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.512197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da26b45ec5fb4e08bc370b1482902ed6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.520644 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da26b45ec5fb4e08bc370b1482902ed6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.527467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1456/2846] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:07:50.528843 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.529476 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:50.535366 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da26b45ec5fb4e08bc370b1482902ed6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.540479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e980d-dca8-4fe7-a0d7-efcda5d18f69 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.543315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1391/2847] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:50 2022] DELETE /identity/v3/users/da26b45ec5fb4e08bc370b1482902ed6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:50.549151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.549774 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.550113 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.550479 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.551103 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.553316 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.588948 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1457/2848] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:50 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:50.593149 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.594716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.667397 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a473b8-db7e-46f5-a13b-b80cba9ceffd admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.729751 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.730255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.730531 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.731111 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.731559 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.733541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.761953 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1392/2849] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:50 2022] POST /identity/v3/users => generated 287 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:50.771301 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.777429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.779687 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.791030 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c987f-55e7-4448-99fb-037b125ad1ec admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.798209 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.798831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.799105 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.799431 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.800028 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.801666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.803749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f13b0-2999-4e51-98fe-e5ae9f6f56bb admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.809843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.810549 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.810843 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.811109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] PATH_INFO: `/v3/projects/dfe50a19254249b2893bc63e4696a80b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.812342 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe50a19254249b2893bc63e4696a80b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.813321 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1458/2850] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:50.814315 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.817185 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.830421 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada8a07-5c3b-4fef-be18-8e6bcd802bea admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.836238 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.837467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.837742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.838021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.839292 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.842484 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.863986 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1459/2851] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:50.872505 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.884411 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28304982-b713-4c64-8431-7e77cafd572b admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:50.890639 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe50a19254249b2893bc63e4696a80b', 'request_id': 'req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.899604 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe50a19254249b2893bc63e4696a80b', 'request_id': 'req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.908633 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe50a19254249b2893bc63e4696a80b', 'request_id': 'req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.922722 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] The token cache is being invalidate because project dfe50a19254249b2893bc63e4696a80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:50.924427 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.925205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:50.927298 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1393/2852] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:50 2022] DELETE /identity/v3/projects/dfe50a19254249b2893bc63e4696a80b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:50.930859 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:50.932263 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:50.947135 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:50.951728 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:50.952424 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:50.952723 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:50.953002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] PATH_INFO: `/v3/projects/dc1cc60e7ccd4dce80d48dbab4308fd0/users/9b30c7c0dbb94e4486c889d3c79c9283/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:50.966060 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:50.970708 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1cc60e7ccd4dce80d48dbab4308fd0, user_id=9b30c7c0dbb94e4486c889d3c79c9283, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:50.973898 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb7caa-b722-4b3d-a167-7e3977da864c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:50.993464 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1460/2853] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:50 2022] PUT /identity/v3/projects/dc1cc60e7ccd4dce80d48dbab4308fd0/users/9b30c7c0dbb94e4486c889d3c79c9283/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:51.005561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:51.005876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:51.006253 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:51.015807 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a18d66-727f-4fa0-8bf2-ebf14171a7f2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:51.038680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] MFA Rules not processed for user `9b30c7c0dbb94e4486c889d3c79c9283`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:51.040195 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:51.080101 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:51.080787 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:51.081365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:51.081508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] PATH_INFO: `/v3/users/8c3e6283fcb84638b228c8d33e0499bd` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:51.082647 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c3e6283fcb84638b228c8d33e0499bd)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:51.084744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:51.112628 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1461/2854] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:51.123997 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:51.126617 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:51.165157 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c3e6283fcb84638b228c8d33e0499bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.166517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c3e6283fcb84638b228c8d33e0499bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.177047 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c3e6283fcb84638b228c8d33e0499bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.188021 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c3e6283fcb84638b228c8d33e0499bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.211606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c3e6283fcb84638b228c8d33e0499bd'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.221131 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1394/2855] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:50 2022] DELETE /identity/v3/users/8c3e6283fcb84638b228c8d33e0499bd => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:51.238471 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4664b4a-66fd-4904-a4b4-dd979cd8f702 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:51.316159 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:51.317156 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:51.317470 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:51.317784 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:51.320636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:51.463296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:51.489332 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:51.492300 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009d217-369f-46ef-9912-cd27d2dc9daf service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:51.508595 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1462/2856] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:51.516798 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:51.518610 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:51.575919 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:51.604520 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ebb6b-d36c-4984-905a-f3928c9aabea admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:51.612451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:51.612451 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:51.613148 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:51.613435 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] PATH_INFO: `/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:51.614994 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf3eb911aec4c15821b3177e21dc2ae)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:51.617744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:51.678528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf3eb911aec4c15821b3177e21dc2ae', 'request_id': 'req-a0b494d6-6b24-4128-aa6d-f026587a4622'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.688958 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf3eb911aec4c15821b3177e21dc2ae', 'request_id': 'req-a0b494d6-6b24-4128-aa6d-f026587a4622'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.699218 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf3eb911aec4c15821b3177e21dc2ae', 'request_id': 'req-a0b494d6-6b24-4128-aa6d-f026587a4622'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.728382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] The token cache is being invalidate because project 7cf3eb911aec4c15821b3177e21dc2ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:51.729382 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.730967 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:51.733926 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1395/2857] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:51 2022] DELETE /identity/v3/projects/7cf3eb911aec4c15821b3177e21dc2ae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:53.057247 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ce5-987b-45b6-baca-4cbaa7c7b05f None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:53.057671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ce5-987b-45b6-baca-4cbaa7c7b05f None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:53.057900 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d2ce5-987b-45b6-baca-4cbaa7c7b05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:53.076841 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b43d2ce5-987b-45b6-baca-4cbaa7c7b05f None None] MFA Rules not processed for user `9b30c7c0dbb94e4486c889d3c79c9283`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:53.078049 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b43d2ce5-987b-45b6-baca-4cbaa7c7b05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:53.137585 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1463/2858] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:53.179740 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:53.181163 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:53.251123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b494d6-6b24-4128-aa6d-f026587a4622 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:53.255753 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:53.256381 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:53.256685 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:53.256992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] PATH_INFO: `/v3/users/c3d50fe7a323482db534f06b7711ee3b` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:53.258103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d50fe7a323482db534f06b7711ee3b)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:53.259998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:53.311529 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d50fe7a323482db534f06b7711ee3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.312418 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d50fe7a323482db534f06b7711ee3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.321507 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d50fe7a323482db534f06b7711ee3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.331993 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d50fe7a323482db534f06b7711ee3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.337883 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:53.347528 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d50fe7a323482db534f06b7711ee3b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.355093 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1396/2859] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:53 2022] DELETE /identity/v3/users/c3d50fe7a323482db534f06b7711ee3b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:53.359419 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:53.359677 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:53.359919 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:53.384458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:53.384458 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:53.466944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1464/2860] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:53.472831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:53.474505 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:53.553810 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4934cea-3bf3-4de5-a0ca-0c574cef6fe0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:53.558081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:53.558784 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:53.559180 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:53.559681 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:53.572456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:53.574052 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:53.585856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1397/2861] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:53.865951 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:53.867614 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:53.885726 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5ab34-3f40-4419-8c98-e93cb3ae3fed None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:53.891166 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:53.892019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:53.892459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:53.892949 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] PATH_INFO: `/v3/projects/7eec2a4f38e544cea8585cb0401ce7ef` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:53.894395 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eec2a4f38e544cea8585cb0401ce7ef)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:53.897073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:53.974213 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eec2a4f38e544cea8585cb0401ce7ef', 'request_id': 'req-30b6d8e2-ff07-479c-99a1-7705e8733bc7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.980322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eec2a4f38e544cea8585cb0401ce7ef', 'request_id': 'req-30b6d8e2-ff07-479c-99a1-7705e8733bc7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:53.988729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eec2a4f38e544cea8585cb0401ce7ef', 'request_id': 'req-30b6d8e2-ff07-479c-99a1-7705e8733bc7'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.000815 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] The token cache is being invalidate because project 7eec2a4f38e544cea8585cb0401ce7ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:54.001109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.001876 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.003249 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1465/2862] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:53 2022] DELETE /identity/v3/projects/7eec2a4f38e544cea8585cb0401ce7ef => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:54.007827 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:54.017988 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5734e-d707-484f-9a3b-d87fbfb4d582 service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:54.079197 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:54.079818 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.080094 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.080365 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] PATH_INFO: `/v3/users/58bd6d5c9c3040168d5407e7d1224e9c` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.081524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bd6d5c9c3040168d5407e7d1224e9c)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:54.083441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:54.137551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bd6d5c9c3040168d5407e7d1224e9c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.138286 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bd6d5c9c3040168d5407e7d1224e9c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.145905 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bd6d5c9c3040168d5407e7d1224e9c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.154008 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bd6d5c9c3040168d5407e7d1224e9c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.168856 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-ee538360-4e73-4527-934b-ba3bc4f2cc64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bd6d5c9c3040168d5407e7d1224e9c'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.176152 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1398/2863] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:54 2022] DELETE /identity/v3/users/58bd6d5c9c3040168d5407e7d1224e9c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:54.458543 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:54.460914 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:54.475009 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b6d8e2-ff07-479c-99a1-7705e8733bc7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:54.497107 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:54.553548 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:54.554888 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.555172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.555446 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] PATH_INFO: `/v3/projects/cda6346e728d4e898cffc90d51dbcd2f` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.557187 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda6346e728d4e898cffc90d51dbcd2f)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:54.559631 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:54.607564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda6346e728d4e898cffc90d51dbcd2f', 'request_id': 'req-2da9080d-51f4-444d-a9ff-ed9408ad5983'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.615310 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda6346e728d4e898cffc90d51dbcd2f', 'request_id': 'req-2da9080d-51f4-444d-a9ff-ed9408ad5983'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.623027 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda6346e728d4e898cffc90d51dbcd2f', 'request_id': 'req-2da9080d-51f4-444d-a9ff-ed9408ad5983'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.634635 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] The token cache is being invalidate because project cda6346e728d4e898cffc90d51dbcd2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:54.634926 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.635567 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-2da9080d-51f4-444d-a9ff-ed9408ad5983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:54.637098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1466/2864] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:54 2022] DELETE /identity/v3/projects/cda6346e728d4e898cffc90d51dbcd2f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:54.643461 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.644916 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.645425 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.678170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:54.679931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:54.684357 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:54.742081 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1399/2865] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:54.805803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.806161 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.806367 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.831342 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:54.832790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:54.842613 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1467/2866] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:54.847235 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:54.859195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83be1d0-abb2-49e0-9987-3f239ebbdbc5 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:54.865211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:54.865885 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.866182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.867245 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] PATH_INFO: `/v3/domains` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.868053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81624) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:54.868364 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:54.870158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:54.887043 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1400/2867] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:07:54.889037 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:54.906241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6f7e5-f2bb-41f3-8752-e73f9aaa3522 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:54.914999 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:54.915623 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:54.915916 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:54.916183 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:54.917671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:54.919938 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:54.972472 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1468/2868] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:54 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:54.973948 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:54.988408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057b8f0-06e4-4410-9031-6a639494493f admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.092783 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.093039 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.093268 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.093415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.094473 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.096523 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.125806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1401/2869] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:54 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:55.127412 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.140824 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc1c36-0975-4506-a8c9-1f6923925451 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.145435 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.146036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.146322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.146600 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.147240 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.149389 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.159206 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1469/2870] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:55.165943 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.184076 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7270be2-ac1e-45d5-96e5-7b5ab1b429ee admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.191774 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.192841 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.193336 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.193822 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.195019 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.198065 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a8a69f-a102-47f3-b440-2d51052a2082 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.218700 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1402/2871] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:55.222671 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.233414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be13b826-c1f4-4553-89cb-a3f7d8a2e8b1 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.238918 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.239711 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] REQUEST_METHOD: `PUT` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.240124 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.240529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] PATH_INFO: `/v3/projects/ee6ed762d9b94f90bd62aff6ba70206d/users/c8422b58076a425ab27e4cc2e87ef0e8/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.257584 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee6ed762d9b94f90bd62aff6ba70206d, user_id=c8422b58076a425ab27e4cc2e87ef0e8, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.260385 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.274302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1470/2872] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:55 2022] PUT /identity/v3/projects/ee6ed762d9b94f90bd62aff6ba70206d/users/c8422b58076a425ab27e4cc2e87ef0e8/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:55.284328 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.284650 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.284936 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.313897 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] MFA Rules not processed for user `c8422b58076a425ab27e4cc2e87ef0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:55.315120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:55.384748 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1403/2873] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:55.389556 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.443116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:55.468162 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088631ad-736d-4bf3-945c-0162e73cd85f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.473375 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.474109 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.474451 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.474793 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.475523 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.477566 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.506656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1471/2874] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:55 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:55.511140 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.517830 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:55.523448 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0c2d8-4466-46ee-b984-4ebdabfd8b3e None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.594906 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.595538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.595847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.597206 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] PATH_INFO: `/v3/users` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.597855 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.599846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.626459 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1404/2875] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:55 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:55.630755 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.641982 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044da36-0990-4781-855b-9a8cbafa36b7 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.646924 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.647729 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.648011 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.648296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.648983 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.650630 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.661569 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1472/2876] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:55.665876 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.676589 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd793c3-22b0-4c91-a492-c8900058392a admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.682282 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.682938 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.683215 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.683486 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] PATH_INFO: `/v3/projects/34f3cdcf3dc645d495302563a38a375b/users/283053ef0fb34599b5d1f4cbb7e248ff/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.700801 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f3cdcf3dc645d495302563a38a375b, user_id=283053ef0fb34599b5d1f4cbb7e248ff, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.703338 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.716870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1405/2877] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:55 2022] PUT /identity/v3/projects/34f3cdcf3dc645d495302563a38a375b/users/283053ef0fb34599b5d1f4cbb7e248ff/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:55.721251 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.731680 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9684534-fbce-42a0-826e-95a71bf69c51 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.791970 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.792616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.792894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.793165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.793811 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.795399 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5557fe-0248-4a1b-b51c-df56b9b210ba admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.806004 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1473/2878] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:55 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:55.810141 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.821407 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1389959-8202-4ed3-8edc-d545482a5510 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:55.826542 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:55.827211 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.827492 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.827766 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] PATH_INFO: `/v3/projects/34f3cdcf3dc645d495302563a38a375b/users/283053ef0fb34599b5d1f4cbb7e248ff/roles/3643a2fbd54c49d3b2dc7f769bd3aa79` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.829733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34f3cdcf3dc645d495302563a38a375b, user_id=283053ef0fb34599b5d1f4cbb7e248ff, role_id=3643a2fbd54c49d3b2dc7f769bd3aa79)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:55.832359 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:55.843123 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1406/2879] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:55 2022] PUT /identity/v3/projects/34f3cdcf3dc645d495302563a38a375b/users/283053ef0fb34599b5d1f4cbb7e248ff/roles/3643a2fbd54c49d3b2dc7f769bd3aa79 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:55.854673 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:55.855024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:55.855382 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:55.887945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] MFA Rules not processed for user `283053ef0fb34599b5d1f4cbb7e248ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:55.890273 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:55.980666 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1474/2880] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:55.995831 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:55.998185 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:56.087011 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b247c40-2562-4082-9c32-91dcc6268ea1 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:56.090873 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:56.091661 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:56.091942 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:56.092259 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:56.103103 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:56.104565 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:56.114782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1407/2881] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:56.228800 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:56.240036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c46c3d-d297-4cad-8e80-85b60eb258d9 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:56.244781 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:56.245513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:56.245896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:56.246270 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:56.285979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:56.311636 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:56.313116 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6558aeed-f271-4ee8-98d4-c2293e75f1f3 service cinder] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:56.322443 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1475/2882] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:58.945860 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:59.007156 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677d44a-63c1-4470-a093-129b6969885b service cinder] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:59.011643 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:59.012273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:59.012575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:59.012847 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] PATH_INFO: `/v3/users/c8422b58076a425ab27e4cc2e87ef0e8` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:59.013991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8422b58076a425ab27e4cc2e87ef0e8)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:59.015983 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:59.019027 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:59.064470 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8422b58076a425ab27e4cc2e87ef0e8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.065124 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8422b58076a425ab27e4cc2e87ef0e8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.078720 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8422b58076a425ab27e4cc2e87ef0e8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.086402 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8422b58076a425ab27e4cc2e87ef0e8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.101213 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8422b58076a425ab27e4cc2e87ef0e8'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.107992 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1408/2883] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:58 2022] DELETE /identity/v3/users/c8422b58076a425ab27e4cc2e87ef0e8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:59.112859 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:59.113359 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:59.113476 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:59.132700 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:59.133894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:59.192481 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1476/2884] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:07:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:59.203132 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:59.204611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:59.279917 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edc755-d989-430b-9e8e-3ee2a75697cc admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:59.284663 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:59.285295 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:59.285575 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:59.285846 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:59.300231 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:59.302939 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:59.314220 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1409/2885] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:59.729498 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:59.731529 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:59.755934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8254c8a-a402-421f-bcb0-7ef4eabf0ad6 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:59.768946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:59.769591 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:59.769872 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:59.770141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] PATH_INFO: `/v3/projects/ee6ed762d9b94f90bd62aff6ba70206d` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:59.773232 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee6ed762d9b94f90bd62aff6ba70206d)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:59.775791 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:59.849789 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee6ed762d9b94f90bd62aff6ba70206d', 'request_id': 'req-7823b23a-23b8-4071-991d-a81eec737ff9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.856606 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee6ed762d9b94f90bd62aff6ba70206d', 'request_id': 'req-7823b23a-23b8-4071-991d-a81eec737ff9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.865388 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee6ed762d9b94f90bd62aff6ba70206d', 'request_id': 'req-7823b23a-23b8-4071-991d-a81eec737ff9'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.879973 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] The token cache is being invalidate because project ee6ed762d9b94f90bd62aff6ba70206d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:59.880302 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.881019 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:59.882965 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1477/2886] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:59 2022] DELETE /identity/v3/projects/ee6ed762d9b94f90bd62aff6ba70206d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:59.886806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:59.899316 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b542ba4d-e64a-44ea-bca1-8885df872ecf service neutron] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:59.961912 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:59.963262 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:59.963538 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:59.963817 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] PATH_INFO: `/v3/users/283053ef0fb34599b5d1f4cbb7e248ff` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:59.965045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283053ef0fb34599b5d1f4cbb7e248ff)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:59.966940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:59.992207 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:00.015758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283053ef0fb34599b5d1f4cbb7e248ff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.016441 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283053ef0fb34599b5d1f4cbb7e248ff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.024325 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283053ef0fb34599b5d1f4cbb7e248ff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.032168 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283053ef0fb34599b5d1f4cbb7e248ff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.044659 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283053ef0fb34599b5d1f4cbb7e248ff'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.050524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1410/2887] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:59 2022] DELETE /identity/v3/users/283053ef0fb34599b5d1f4cbb7e248ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:00.336544 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:00.337829 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:00.366036 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823b23a-23b8-4071-991d-a81eec737ff9 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:00.436532 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:00.437151 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:00.437432 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:00.437707 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] PATH_INFO: `/v3/projects/34f3cdcf3dc645d495302563a38a375b` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:00.438809 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34f3cdcf3dc645d495302563a38a375b)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:00.440749 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:00.442921 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:00.487891 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34f3cdcf3dc645d495302563a38a375b', 'request_id': 'req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.493266 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34f3cdcf3dc645d495302563a38a375b', 'request_id': 'req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.500690 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34f3cdcf3dc645d495302563a38a375b', 'request_id': 'req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.512415 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] The token cache is being invalidate because project 34f3cdcf3dc645d495302563a38a375b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81623) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:00.512727 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.513374 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-22b66f8b-cbdb-4e43-80dd-edca57d9b9f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:00.514847 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1478/2888] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:00 2022] DELETE /identity/v3/projects/34f3cdcf3dc645d495302563a38a375b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:02.338989 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:02.340606 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:02.451415 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301229bc-f4ce-43e2-a488-1970d0d2dbe2 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:02.539526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02cff3a52a8e47feb0acc62f084f110a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:02.540147 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:02.540456 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:02.540749 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:02.542551 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:02.555050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:02.556755 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:02.568517 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1411/2889] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:08.578066 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadb84-0dc3-4f25-97e6-95c9bdf3746b None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:08.578540 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadb84-0dc3-4f25-97e6-95c9bdf3746b None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:08.578662 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aadb84-0dc3-4f25-97e6-95c9bdf3746b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:08.599504 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c2aadb84-0dc3-4f25-97e6-95c9bdf3746b None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:08.600765 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c2aadb84-0dc3-4f25-97e6-95c9bdf3746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:08.656759 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1479/2890] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:08:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:08.668870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:08.670297 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:08.697404 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:08.739089 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc27f71-b20f-4363-8d3e-0ba52031d51e service nova] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:08.744675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:08.745281 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:08.745554 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:08.745824 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:08.753974 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:08.755553 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:08.764309 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1412/2891] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:08:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:08:09.283322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ac40-32c1-45f9-9aa7-02db806e156a None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.283616 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ac40-32c1-45f9-9aa7-02db806e156a None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.283896 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10ac40-32c1-45f9-9aa7-02db806e156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.303979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-3e10ac40-32c1-45f9-9aa7-02db806e156a None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:09.305227 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-3e10ac40-32c1-45f9-9aa7-02db806e156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:09.312414 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1480/2892] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:09.324471 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:09.338987 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb67c76-a5c1-44de-9ccb-f5cd8915cfd8 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:09.344256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:09.344957 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.345319 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.345624 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.355170 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:09.358083 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:09.368903 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1413/2893] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 03:08:09.615633 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647708e8-b329-4d15-84cc-6255663f58a2 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.616141 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647708e8-b329-4d15-84cc-6255663f58a2 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.616241 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647708e8-b329-4d15-84cc-6255663f58a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.636254 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-647708e8-b329-4d15-84cc-6255663f58a2 None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:09.637513 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-647708e8-b329-4d15-84cc-6255663f58a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:09.644803 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1481/2894] 10.222.0.64 () {58 vars in 1009 bytes} [Thu Aug 25 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:09.658631 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:09.671097 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039ab2-7e96-418a-b4b6-c9082478280e service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:09.677613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:09.678469 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.678820 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.679158 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.688489 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:09.690423 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:09.699214 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1414/2895] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:08:10.040073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.040339 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.040651 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.060696 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] MFA Rules not processed for user `e0de8775c6564365b4a7c3268392b258`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:10.061944 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.069496 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1482/2896] 10.222.0.64 () {58 vars in 967 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:08:10.081736 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.092844 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb06f0-23ed-4383-8d71-203a0a168de0 service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.097922 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '187876bda81c4d66a857ba9d8c4affaf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.098524 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.098804 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.099109 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.108045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.109678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.118763 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1415/2897] 10.222.0.64 () {60 vars in 1384 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:08:11.034684 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:11.036322 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:11.111457 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40fe57-3bd5-4747-83c1-4e56b4e9ebbd None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.116710 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.117377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.117659 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.117937 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] PATH_INFO: `/v3/users/ebc58cc61d1e4b87a1882a4e9a8cc03a` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.119088 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc58cc61d1e4b87a1882a4e9a8cc03a)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.121094 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.146787 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.174892 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc58cc61d1e4b87a1882a4e9a8cc03a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.184945 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc58cc61d1e4b87a1882a4e9a8cc03a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.193968 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc58cc61d1e4b87a1882a4e9a8cc03a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.194856 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc58cc61d1e4b87a1882a4e9a8cc03a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.207303 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc58cc61d1e4b87a1882a4e9a8cc03a'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.214054 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1483/2898] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:11 2022] DELETE /identity/v3/users/ebc58cc61d1e4b87a1882a4e9a8cc03a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:11.424256 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:11.439733 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ae9e-1615-4b54-82da-657824b0179a service swift] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.457024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:11.459058 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:11.512120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.512907 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.513186 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.513495 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] PATH_INFO: `/v3/projects/cced5962e75d4df7a1014ff7f7845ba1` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.515635 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cced5962e75d4df7a1014ff7f7845ba1)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.517762 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.534519 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730a1d3-0b0e-4996-a683-5ab0de173f52 admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.540895 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.541542 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.541831 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.542110 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] PATH_INFO: `/v3/users/9b30c7c0dbb94e4486c889d3c79c9283` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.543499 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b30c7c0dbb94e4486c889d3c79c9283)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.545477 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.573394 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cced5962e75d4df7a1014ff7f7845ba1', 'request_id': 'req-e74bd0c9-6469-4d83-b8fb-c086f10f290b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.580440 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cced5962e75d4df7a1014ff7f7845ba1', 'request_id': 'req-e74bd0c9-6469-4d83-b8fb-c086f10f290b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.588745 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cced5962e75d4df7a1014ff7f7845ba1', 'request_id': 'req-e74bd0c9-6469-4d83-b8fb-c086f10f290b'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.598604 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b30c7c0dbb94e4486c889d3c79c9283'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.602496 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] The token cache is being invalidate because project cced5962e75d4df7a1014ff7f7845ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:11.604001 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.605053 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-e74bd0c9-6469-4d83-b8fb-c086f10f290b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.606853 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1416/2899] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:11 2022] DELETE /identity/v3/projects/cced5962e75d4df7a1014ff7f7845ba1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:11.607305 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b30c7c0dbb94e4486c889d3c79c9283'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.615656 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b30c7c0dbb94e4486c889d3c79c9283'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.616430 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b30c7c0dbb94e4486c889d3c79c9283'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.631440 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b30c7c0dbb94e4486c889d3c79c9283'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.638355 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1484/2900] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:11 2022] DELETE /identity/v3/users/9b30c7c0dbb94e4486c889d3c79c9283 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:11.643594 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.644045 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.644335 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.653312 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.666750 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:11.668526 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:11.736182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1417/2901] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:08:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:11.747429 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:11.748959 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:11.769644 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:11.816467 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725679d2-1d53-4c3a-a0c7-3aadf1c84e7d admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.820224 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.820885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.821171 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.821448 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.831646 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.833073 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a0705-bd8b-427e-a684-40a8a26f8275 service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.844588 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1485/2902] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:12.018136 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.019679 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:12.033195 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0048e909-44b2-4c12-bfac-fa51d3e8aadc None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.039323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.040086 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.040367 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.040706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] PATH_INFO: `/v3/projects/dc1cc60e7ccd4dce80d48dbab4308fd0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.042113 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1cc60e7ccd4dce80d48dbab4308fd0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.044120 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.100678 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1cc60e7ccd4dce80d48dbab4308fd0', 'request_id': 'req-0a5a3edf-2925-429b-b5c1-a373da3913b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:12.106370 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1cc60e7ccd4dce80d48dbab4308fd0', 'request_id': 'req-0a5a3edf-2925-429b-b5c1-a373da3913b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:12.114567 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1cc60e7ccd4dce80d48dbab4308fd0', 'request_id': 'req-0a5a3edf-2925-429b-b5c1-a373da3913b6'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:12.126283 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] The token cache is being invalidate because project dc1cc60e7ccd4dce80d48dbab4308fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:12.126611 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:12.127240 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-0a5a3edf-2925-429b-b5c1-a373da3913b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:12.128782 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1418/2903] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:12 2022] DELETE /identity/v3/projects/dc1cc60e7ccd4dce80d48dbab4308fd0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:12.134423 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.134939 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.135067 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.157218 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:12.158459 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:12.230977 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1486/2904] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:12.239279 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.239562 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.239836 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.260115 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:12.261383 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:12.270013 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1419/2905] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:12.275377 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.285409 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a02768-a4dc-465b-bad5-435d787cddb4 None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.290051 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.290654 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.290934 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.291208 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] PATH_INFO: `/v3/domains` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.291852 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81623) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:08:12.292165 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.293790 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.307153 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1487/2906] 10.222.0.64 () {58 vars in 1153 bytes} [Thu Aug 25 03:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:08:12.311850 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.322429 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a665e-cb3d-421a-9644-d5f94d772932 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.327072 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.327675 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.327940 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.328205 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] PATH_INFO: `/v3/projects` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.328870 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.330796 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.361744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1420/2907] 10.222.0.64 () {60 vars in 1153 bytes} [Thu Aug 25 03:08:12 2022] POST /identity/v3/projects => generated 391 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:08:12.366134 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.379661 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaf72a-3db8-407e-986f-55233c0e936f admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.444130 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.444776 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.445056 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.445340 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] PATH_INFO: `/v3/users` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.445966 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.448250 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.471985 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1488/2908] 10.222.0.64 () {60 vars in 1144 bytes} [Thu Aug 25 03:08:12 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:08:12.476154 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.486744 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7315739-4b03-462e-b4ab-ea7c7e395270 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.492257 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.492910 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.493217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.493467 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.494230 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.495894 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.508890 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1421/2909] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:12.512597 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.523296 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70544a9-8ae5-452e-abd7-e2f8c6082b4c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.528089 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.528742 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.529024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.529331 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.530002 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.531608 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c36ba-4804-4421-a8f0-a7ef678571e9 admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.542989 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1489/2910] 10.222.0.64 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:12.547442 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.560177 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f39b0e-6876-4364-8aa2-0b8c52eafb93 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.565485 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.566169 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.566439 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.566708 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] PATH_INFO: `/v3/projects/7a81c7a6f6284bc2809f2beaa442c6b0/users/84ac92ec39c545f2935a35d054c69e60/roles/ef2ea20953d74d4098b2be1220175b2d` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.585037 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a81c7a6f6284bc2809f2beaa442c6b0, user_id=84ac92ec39c545f2935a35d054c69e60, role_id=ef2ea20953d74d4098b2be1220175b2d)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.588252 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.602704 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1422/2911] 10.222.0.64 () {60 vars in 1483 bytes} [Thu Aug 25 03:08:12 2022] PUT /identity/v3/projects/7a81c7a6f6284bc2809f2beaa442c6b0/users/84ac92ec39c545f2935a35d054c69e60/roles/ef2ea20953d74d4098b2be1220175b2d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:12.677193 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a693-84b4-4892-a131-920dce8620bb None None] REQUEST_METHOD: `POST` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.678098 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a693-84b4-4892-a131-920dce8620bb None None] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.678516 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212a693-84b4-4892-a131-920dce8620bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.715724 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.auth.core [None req-c212a693-84b4-4892-a131-920dce8620bb None None] MFA Rules not processed for user `84ac92ec39c545f2935a35d054c69e60`. Rule list: `[]` (Enabled: `True`). {{(pid=81623) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:12.717172 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-c212a693-84b4-4892-a131-920dce8620bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:12.729929 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:12.794984 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1490/2912] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:08:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:12.806791 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:12.809050 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:12.846217 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:12.882719 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0451e41-1995-42db-b0bd-c31e11d933e0 admin admin] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:12.886613 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '23232654097d435a9ebe540ada43804d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:12.887223 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] REQUEST_METHOD: `GET` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:12.887508 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:12.887758 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:12.898313 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:12.899806 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fa4e-7380-42c6-97e6-ca4d9260c72e service cinder] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:12.910619 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1423/2913] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:22.791990 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=21 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:22.905285 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=15 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:23.008833 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a693-84b4-4892-a131-920dce8620bb None None] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:23.069979 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212a693-84b4-4892-a131-920dce8620bb None None] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:23.074398 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:23.075021 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:23.075295 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:23.075564 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] PATH_INFO: `/v3/users/84ac92ec39c545f2935a35d054c69e60` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:23.076706 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=84ac92ec39c545f2935a35d054c69e60)` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:23.078602 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:23.125770 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84ac92ec39c545f2935a35d054c69e60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.133629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84ac92ec39c545f2935a35d054c69e60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.140946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84ac92ec39c545f2935a35d054c69e60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.141097 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84ac92ec39c545f2935a35d054c69e60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.152946 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.notifications [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84ac92ec39c545f2935a35d054c69e60'} {{(pid=81623) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.159057 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1491/2914] 10.222.0.64 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:23 2022] DELETE /identity/v3/users/84ac92ec39c545f2935a35d054c69e60 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:23.163706 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] REQUEST_METHOD: `POST` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:23.163991 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:23.164265 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:23.183182 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.auth.core [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] MFA Rules not processed for user `0022827a1ab44829a57581031fab2445`. Rule list: `[]` (Enabled: `True`). {{(pid=81624) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:23.184408 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:23.242255 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1424/2915] 10.222.0.64 () {58 vars in 958 bytes} [Thu Aug 25 03:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:23.252223 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:23.253772 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:23.310561 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038cebb1-f21a-4244-a7a7-3eb7a1121b1c admin admin] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:23.314410 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '868cf3d873a349d1bc43e309a9a6acc2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:23.315024 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:23.315304 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:23.315573 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:23.325360 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:23.326718 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:23.336338 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1492/2916] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:23.603110 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] Authenticating user token {{(pid=81624) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:23.604585 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.fernet_utils [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81624) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:23.619630 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d214bc9-5f51-4117-8202-3a028ed2faa2 None None] Validating token access rules against request {{(pid=81624) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:23.624341 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0022827a1ab44829a57581031fab2445', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c90428e27344b52a75997c9ee93262e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81624) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:23.624998 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:23.625273 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:23.625541 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] PATH_INFO: `/v3/projects/7a81c7a6f6284bc2809f2beaa442c6b0` {{(pid=81624) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:23.626716 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a81c7a6f6284bc2809f2beaa442c6b0)` {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:23.629587 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] RBAC: Authorization granted {{(pid=81624) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:23.676323 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a81c7a6f6284bc2809f2beaa442c6b0', 'request_id': 'req-c131935f-670d-46a4-92e1-e9300a9e98b1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.682420 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a81c7a6f6284bc2809f2beaa442c6b0', 'request_id': 'req-c131935f-670d-46a4-92e1-e9300a9e98b1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.689573 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a81c7a6f6284bc2809f2beaa442c6b0', 'request_id': 'req-c131935f-670d-46a4-92e1-e9300a9e98b1'} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.700602 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] The token cache is being invalidate because project 7a81c7a6f6284bc2809f2beaa442c6b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81624) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:23.700931 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.701566 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG keystone.notifications [None req-c131935f-670d-46a4-92e1-e9300a9e98b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81624) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:23.703040 dv-cinder-851640-5-smb devstack@keystone.service[81624]: [pid: 81624|app: 0|req: 1425/2917] 10.222.0.64 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:23 2022] DELETE /identity/v3/projects/7a81c7a6f6284bc2809f2beaa442c6b0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:33.331858 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:33.697588 dv-cinder-851640-5-smb devstack@keystone.service[81624]: DEBUG dbcounter [-] [81624] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:48.522894 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] Authenticating user token {{(pid=81623) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:48.524369 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:48.594884 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8069de8-713f-4d16-9e88-9f5a8dc2022c service neutron] Validating token access rules against request {{(pid=81623) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:48.656885 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '51e6b673144045b5baffab410e261706', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f318c94ba4141a7ab2d48b7abecbb9b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81623) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:48.657404 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] REQUEST_METHOD: `GET` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:48.657685 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] SCRIPT_NAME: `/identity` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:48.657962 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81623) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:48.659750 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.fernet_utils [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81623) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:48.671957 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:48.673565 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62583d-244e-438c-bd14-cc4350af867a service placement] RBAC: Authorization granted {{(pid=81623) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:48.685449 dv-cinder-851640-5-smb devstack@keystone.service[81623]: [pid: 81623|app: 0|req: 1493/2918] 10.222.0.64 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:10:58.679629 dv-cinder-851640-5-smb devstack@keystone.service[81623]: DEBUG dbcounter [-] [81623] Writing DB stats keystone:SELECT=58 {{(pid=81623) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}